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Introduction and Overview 

Quantum mechanics is our most successful physical theory. It underlies our very detailed 
understanding of atomic physics, chemistry, and nuclear physics, and the many technologies 
to which physical systems in these regimes give rise. Additionally, relativistic quantum 
mechanics is the basis for the standard model of elementary particles, which very successfully 
gives a partial unification of the forces operating at the atomic, nuclear, and subnuclear levels. 

However, from its inception the probabilistic nature of quantum mechanics, and the fact 
that "quantum measurements" require the intervention of non-quantum mechanical "classical 
systems" , has led to speculations by many physicists, mathematicians, and philosophers of 
science that quantum mechanics may be incomplete. In an opposing camp, many others 
in these communities have attempted to provide an interpretational foundation in which 
quantum mechanics remains a complete and self-contained system. The debate continues, 
and has spawned an enormous literature. 

We shall not attempt any historical review, although specific aspects of the discussions 
of the past decades will make their appearance where relevant to our exposition. Rather, 
we shall turn to a statement of the purpose of this book. Our aim is to make the case that 
quantum mechanics is not a complete theory, but rather is an emergent phenomenon arising 
from the statistical mechanics of matrix models that have a global unitary invariance. We use 
"emergent" here in the sense that it is used in condensed matter, molecular dynamics, and 
complex systems theory, where higher level phenomena (phonons, superconductivity, fluid 
mechanics,...) are seen to arise or "emerge" as the expressions, in appropriate dynamical 
contexts, of an underlying dynamics that at first glance shows little resemblance to these 
phenomena. Initial ideas in this direction were developed by the author and collaborators 
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in a number of papers dealing with the properties of what we termed "generalized quantum 
dynamics" or, in the terminology that we shall use in this exposition, "trace dynamics." The 
purpose of this book is to give a comprehensive review of this earlier work, with a number 
of significant additions and modifications that bring the project closer to its goal. We shall 
also relate our proposal to a substantial body of literature on stochastic modifications of 
the Schrodinger equation, which we believe provides the low energy phenomenology for the 
pre-quantum dynamics that we develop here. 

Certain sections of this book are more technical and, although included for completeness, 
are not essential to follow the main line of development; these are marked with an asterisk 
(*) in the section head. The exposition of the text is set within the framework of complex 
Hilbert space, but many of the ideas carry over to a statistical dynamics of matrix models 
in real or quaternionic Hilbert space where, as in the case of complex Hilbert space, an 
emergent complex quantum mechanics still results. Modifications necessary in order for the 
results derived in the text to apply in real and quaternionic Hilbert space are sketched in 
Appendix A. Discussions of other topics needed to keep our treatment self-contained are 
given in the remaining appendices. In particular, a survey of the properties of the energy- 
driven stochastic Schrodinger equation is given in Appendices G, H, and I, and our notational 
conventions are reviewed in the introductory paragraphs preceding Appendix A. 
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1. Trace Dynamics: The Classical Lagrangian and Hamiltonian Dynamics of Matrix Models 

We begin by setting up a classical Lagrangian and Hamiltonian dynamics for matrix 
models. We shall assume finite dimensional matrices, although ultimately an extension to 
the infinite dimensional case may be needed. Let B\ and B 2 be two N x N matrices with 
matrix elements that are even grade elements of a Grassmann algebra over the complex 
numbers, and let Tr be the ordinary matrix trace, which obeys the cyclic property 

TrB 1 B 2 = Y,( B ^mn{B 2 )nm = ^(5 2 ) nm ( J B 1 ) mn = T^B 2 B 1 . (1.1a) 

m,n m,n 

Similarly, let Xi an d X2 be two N x N matrices with matrix elements that are odd grade 
elements of a Grassmann algebra over the complex numbers, which anticommute rather than 
commute, so that the cyclic property for these takes the form 

TrXlX2 = ^(Xl)mn(X2)nm = ~ nm(Xl) mn = -Tr^Xl ■ (1-16) 

m,n m,n 

Since the even and odd grade elements of a Grassmann algebra over the complex numbers 
commute, one has a final bilinear cyclic identity 

TrBx = TrxB . (1.1c) 

We shall refer to the Grassmann even and Grassmann odd matrices B, x as being of bosonic 
and fermionic type, respectively. 

The cyclic/anticyclic properties of Eqs. (l.la-c) are the basic identities from which fur- 
ther cyclic properties can be derived. For example, from the basic bilinear identities one 
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immediately derives the trilinear cyclic identities 

TVBi[5 2) B 3 \ =TrB 2 [B 3 , B x \ = TrB 3 [B u B 2 \ , 

TrB ± {B 2 , B 3 } =TrB 2 {B 3 , B x } = TrB 3 {B ± , B 2 } , 

TrB{ X uX2} =Ttxi[ X 2,B] = Tr X2 [XuB} , 

Trxi{5,X2} =Tr{ X i,B} X 2=Tr\xi,X2]B , 

(1.2) 

Tr X [Bi, B 2 ] =TiB 2 [ X , B ± ] = TrB 1 [B 2 , X ] , 

Tr X {B 1 ,B 2 } =TtB 2 {x,B 1 } = TtB 1 {B 2 ,x} , 

Trxife, Xs} =Trx 2 {X3, Xi} = Trx 3 {Xi, X2] , 

Trxi[x 2 , Xs] =Trx 2 [Xs, Xi] = Trx 3 [Xi, X2] , 
which are used repeatedly in trace dynamics calculations. In these equations, and throughout 
the text, [X, Y] = XY — YX denotes a matrix commutator, and {X, Y} = XY + YX a 
matrix anticommutator. 

The basic observation of trace dynamics [1] is that given the trace of a polynomial P con- 
structed from noncommuting matrix or operator variables (we shall use the terms "matrix" 
and "operator" interchangeably in the following discussion), one can define a derivative of 
the complex number TrP with respect to an operator variable O by varying and then cycli- 
cally permuting so that in each term the factor SO stands on the right. This gives the 
fundamental definition 

5TrP 

5TrP = Tr— — 50 , (1.3a) 
oO 

or in the condensed notation that we shall use throughout this book, in which P = TrP, 

SP = Tr^dO . (1.36) 



Note that the derivative SP/SO thus defined is an operator. In general we will take O to be 
either of bosonic or fermionic (but not of mixed) type, and we will construct P to always be 
an even grade element of the Grassmann algebra. With these restrictions, SP/SO will be of 
the same type as O, that is, either both will be bosonic or both will be fermionic. 

The definition of Eq. (1.3b) has the important property that if SP vanishes for arbitrary 
variations SO of the same type as O, then the operator derivative SP/SO must vanish. To 
see this, let us expand SP/SO in the form 

SP 

— = J2C n K n , (1.4a) 

n 

with the K n distinct Grassmann monomials that are all c-numbers (i.e., multiples of the 
N x N unit matrix), and with the C n complex matrix coefficients that are unit elements in 
the Grassmann algebra. Let us choose SO to be an infinitesimal e times Cj, with e a real 
number when O is bosonic, and with e a Grassmann element not appearing in K p when O is 
fermionic. (There must be at least one such element, or else K p would make an identically 
vanishing contribution to Eq. (1.3b), and could not appear in the sum in Eq. (1.4a).) We 
then have 

= ^TrCjC n tf n e , (1.46) 

n 

and since the coefficients of all distinct Grassmann monomials must vanish separately, we 
have in particular 

= TrCjC p . (1.4c) 

This implies the vanishing of the matrix coefficient C p , and letting p range over all index 
values appearing in the sum in Eq. (1.4a), we conclude that 



When O is bosonic, a useful extension of the above result states that the vanishing of SP 
for all self-adjoint variations SO, or for all anti-self-adjoint variations SO, still implies the 
vanishing of 5P/50. To prove this, split each C n in Eq. (1.4a) into self-adjoint and anti-self- 
adjoint parts, C n = C s n a + C a n sa , with C s n a = Q at and C a n sa = -Q sat . For self-adjoint SO, 
Eq. (1.1a) implies that TvC n a SO is real, and TrC^SO is imaginary, and so the vanishing of 
5P implies that both of these traces must vanish separately. Taking 50 = C s v a then implies 
the vanishing of C s p a , while taking SO = iCp Sa then implies the vanishing of Cp Sa . A similar 
argument, with the role of reals and imaginaries interchanged, applies to the case in which 
SO is restricted to be anti-self-adjoint. 

In our applications, we shall often consider trace functionals P that are real. These have 
the important property that when O is a self-adjoint bosonic operator, then SP /SO is also 
self-adjoint. To prove this, we make a self-adjoint variation SO, and use the reality of P to 
write 



This implies, by the extension given in the preceding paragraph, that the anti-self-adjoint 
part of SP/SO must vanish. Similarly, when P is real and SO is anti-self-adjoint, then 
SP I SO is also anti-self-adjoint. 

We can now proceed to use the apparatus just described to set up a Lagrangian and 
Hamiltonian dynamics for matrix models. Let L[{q r }, {q r }} be a Grassmann even polynomial 
function of the bosonic or fermionic operators {q r } and their time derivatives {q r }, which 
are all assumed to obey the cyclic relations of Eqs. (l.la-c) and (1.2) under the trace. From 




(1.5) 
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L, we form the trace Lagrangian 

UUAAQr}] =TrL[{q r },{q r }} , (1.6a) 
and the corresponding trace action 

S = J dtL . (1.66) 

We shall assume that the trace action is real valued, which requires that L be self-adjoint 
up to a possible total time derivative and/or a possible term with vanishing trace, such as a 
commutator. That is, we require 

L-Lt = ^A 1 + [A 2 ,A 3 ] , (1.6c) 

with Ai j2 ,3 arbitrary. Requiring that the trace action be stationary with respect to variations 
of the qy's that preserve their bosonic or fermionic type, and using the definition of Eq. (1.3b), 
we get 

or after integrating by parts in the second term and discarding surface terms, 

For this to hold for general same-type operator variations 5q r , the coefficient of 5q r in 
Eq. (1.7b) must vanish for all t, giving the operator Euler-Lagrange equations 

5L d 5L _ 

5q r dt Sq r 

Because, by the definition of Eq. (1.3b), we have 

5L \ dL 



SqrJa d(q r ) 3 
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for each r the single Euler-Lagrange equation of Eq. (1.7c) is equivalent to the N 2 Euler- 
Lagrange equations obtained by regarding L as a function of the N 2 matrix element variables 
(q r )ji- (For future reference, we note that the identity of Eq. (1.8) still holds when L is 
replaced by a general complex valued trace functional A.) 

Let us now define the momentum operator p r conjugate to q r by 

5L 

p r = — . (1.9a) 
6q r 

Since the Lagrangian is Grassmann even, p r is of the same bosonic or fermionic type as q r . 
We can now introduce a trace Hamiltonian H by analogy with the usual definition, 

H = Tr^p r g r -L . (1.96) 

r 

In correspondence with Eq. (1.8), the matrix elements (p r )ij of the momentum operator p r 
just correspond to the momenta canonical to the matrix element variables (q r )ji- Performing 
general same-type operator variations, and using the Euler-Lagrange equations, we find from 
Eq. (1.9b) that the trace Hamiltonian H is a trace functional of the operators {q r } and {p r }, 

K = H[{q r },{p r }\ , (1.10a) 

with the operator derivatives 

■7— = -Pr, T~ = e rQr , (1.106) 

oq r op r 
with e r = 1(— 1) according to whether q r ,p r are bosonic (fermionic). 

Letting A and B be two bosonic trace functionals of the operators {q r } and {p r }, it is 
convenient to define the generalized Poisson bracket 

fA Bl-TrVe ( 6A 6B _ 6B 6A \ (111) 
^ r \ 5q r 5p r 5q r 5p r J 
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Then using the Hamiltonian form of the equations of motion, one readily finds that for a 
general bosonic trace functional A[{g r }, {p r }], the time derivative is given by 

| A= ^ + {A , H} ; (1116) 

in particular, letting A be the trace Hamiltonian H, which has no explicit time dependence 
when the Lagrangian has no explicit time dependence, and using the fact that the generalized 
Poisson bracket is antisymmetric in its arguments, it follows that the time derivative of H 
vanishes, 

| H = . (1.12) 

An important property of the generalized Poisson bracket is that it satisfies the Jacobi 
identity, 

{A,{B,C}} + {C,{A,B}} + {B,{C,A}} = . (1.13a) 

This can be proved algebraically in a basis independent way [2] (see Appendix B), and can 
also be proved [3] by inserting a complete set of intermediate states into the trace on the 
right of Eq. (1.11a) and using the complex valued analogs of Eq. (1.8), giving 



m.n.r 



m,n,r 



°QrJ mn \ 5 PrJnm \ S Qr J mn \0Pr J , 

(1.136) 

<9A <9B dB dA 



d\Qr)nm ^\Pr)mn ^ylr)nm d(Pr)m', 

In the second line of Eq. (1.13b), the generalized Poisson bracket has been reexpressed as 
a sum of classical Poisson brackets in which the matrix elements of q r , p r are the classical 
variables, and the Jacobi identity of Eq. (1.13a) then follows from the Jacobi identity for 
the classical Poisson bracket. As a consequence of the Jacobi identity, if Qi and Q 2 are two 
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conserved charges, that is if 



= -Qi = {Qi,H}, 



d 
~dt 



Q 2 = {Q 2 ,H} , 



(1.14) 



then their generalized Poisson bracket {Qi,Q2} also has a vanishing generalized Poisson 
bracket with H, and is conserved. This has the consequence that Lie algebras of symmetries 
can be represented as Lie algebras of trace functionals under the generalized Poisson bracket 
operation. More generally, the Jacobi identity implies that trace dynamics has an underlying 
symplectic geometry that is preserved by the time evolution generated by the total trace 
Hamiltonian [4], in analogy with corresponding symplectic structures in classical dynamics. 
(See Appendix C.) 

It will be useful at this point to introduce a compact notation for the operator phase 
space variables, which emphasizes the symplectic structure. Let us introduce the notation 
Xi — qi , x 2 —pi, x 3 = q 2 , x A = p 2 , ...,x 2 d-i = qD , x 2D = Pd, where by convention we 
list all of the bosonic variables before all of the fermionic ones in the 2D-dimensional phase 
space vector x r . The generalized Poisson bracket of Eq. (1.11a) can now be rewritten as 



and the operator Hamiltonian equations of Eq. (1.10b) can be compactly rewritten as 




(1.15a) 




(1.156) 



The numerical matrix uo rs that appears here is given by 



(1.16a) 



with the 2x2 bosonic and fermionic matrices Qb and tip given respectively by 




(1.166) 
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It is easy to verify that the matrix uj obeys the properties 

( *\ -A ^ _ -A (L17) 

^ )rs —0 r s , / U rs U r t — } U sr Ut r — s t 

r r 

Henceforth, as in Eq. (1.17), we shall not explicitly indicate the range of the summation 
indices; the index r on q r , p r will be understood to have an upper summation limit of D, 
while the index r on x r will be understood to have an upper limit of 2D. 

Using this compact notation one can formally integrate the trace dynamics equations of 
motion. Let j r be a source matrix of the same bosonic or fermionic type as x r , and let us 
define 

X r = Trj r x r , (1.18a) 

so that 

Then the Hamiltonian equations of motion of Eq. (1.15b) can be rewritten [5] as 
X r =Trj r x r = Tr^2 ^rtjrXt 



t 



(1.18c) 



which expresses them as generalized Poisson brackets with the trace Hamiltonian. We can 

now formally integrate the equation of motion for X r (t) by writing 
X r (t) =exp(-{H, ...}t)X r (0) exp({H, ...}*) 

=X r (0) - f {H, X r (0)} + it 2 {H, {H, X r (0)}} - it 3 {H, {H, {H, X r (0)}}} + ... . 

(1.19a) 

In general, the matrix dynamics specified by Eqs. (1.15b) and (1.19a) is not unitary, in other 
words, Eq. (1.19a) is not equivalent to an evolution of the form 

x r (t) = rf(t)x r (0)U(t) , (1.196) 
14 



some unitary U(t). 



2. Additional Generic Conserved Quantities 



We have seen in the previous section that the trace Hamiltonian H is always a conserved 
quantity in the dynamics of matrix models. In this section we introduce two structural 
restrictions on the form of the trace Hamiltonian (or Lagrangian), which lead to two fur- 
ther generic conserved quantities, one a trace quantity N analogous to the fermion num- 
ber operator in field theory, the other an operator C that is reminiscent of the canonical 
commutator-anticommutator structure of field theory. 

Although we shall allow the trace Hamiltonian to have arbitrary polynomial dependences 
on the bosonic variables, let us for the moment restrict the fermionic structure to have the 
bilinear form found in all renormalizable quantum field theory models, by taking H to have 
the form 

H = Tr ^^(p r q s Bi rs + PrB^sQs) + purely bosonic . (2.1a) 

r,s,F 

Here the subscript F indicates a sum over only the fermionic operator phase space variables, 
and B12 are general polynomials in the bosonic variables. From Eq. (2.1a) and the Hamilton 
equations of Eq. (1.10b), we have for fermionic r 

p s = - — = - 2_^{B lrs p r + p r B 2rs ) , 

r F 

q r = — t — = 2_^\q s F>irs + B 2rs q s ) ■ 

° Pr s,F 

Let us now define the trace quantity N by 

N = ^iTi^2[q r ,p r ] = iTi^2q r p r = -iTr^2p r q r . (2.2a) 

r,F r,F r,F 

Then for the time derivative of N we have, from the second of the three equivalent forms of 
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N, 

N = iTi y^(g r p r + q r p r ) , (2.26) 

r,F 

which on substituting the fermion equations of motion of Eq. (2.1b) becomes 

N = iTiJ2[ B 2rs,q s Pr] = ■ (2.3) 

r,s,F 

Thus, N is a conserved trace quantity when the trace Hamiltonian has the bilinear fermionic 
structure of Eq. (2.1a). Inverting the Legendre transformation of Eq. (1.9b), the correspond- 
ing bilinear fermionic trace Lagrangian is 

L = Tr y^Pr-gy ~ Tr ' S ^ j (p r <lsBirs + PrB2 rs Qs) + purely bosonic . (2.4a) 

r,F r,s,F 

In order for the kinetic part of L to be self-adjoint up to a total time derivative, we assign 
adjointness properties of the fermionic variables according to 

q r = ip r , p r = iipl , (2.46) 

which gives 

d (2.4c) 

=l1pllp r -I— (ipWr) 

=PrQr + total time derivative , 
as needed. (A more general construction of the fermionic kinetic Lagrangian, and a corre- 
spondingly more general assignment of adjointness properties of the fermionic variables, will 
be taken up at the end of this section.) Substituting Eq. (2.4b) into Eq. (2.4a), the fermionic 
trace Lagrangian takes the form 

L = Tr ^2 ^l^r ~ Tr ^ i(^l^ s B lrs + ^lB 2rs ^s) + purely bosonic . {2 Ad) 

r,F r,s,F 
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Correspondingly, substituting Eq. (2.4b) into Eq. (2.2a) for N we get 

N = ~Tr 5> r , = -Tr £ ^\ = Tr £ , ( 2 .4e) 

r,F r,F r,F 

showing that, since N is the trace of a self-adjoint quantity, it is real when the fermionic 
adjointness properties are assigned as in Eq. (2.4b). 

The resemblance of N to a fermion number operator suggests that it will be conserved 
even when H is not bilinear, as long as each monomial in H has equal numbers of fermionic 
operators p r = iip\ and q s —tp s , with any values of the mode indices r, s. This is indeed the 
case, and can be seen as follows. Let tt nq ,n p be a monomial term in H containing exactly n q 
factors of fermionic g's, and n p factors of fermionic p's, with any values of the indices r, ... 
labeling fermionic degrees of freedom. Then by a simple counting argument (an application 
of Euler's theorem for homogeneous functions) we have 



5H 



r,F 



(2.5a) 



r,F 



5p r 



Denoting by Nn 9 ,n p the contribution of tt nq ,n p to N , we have by use of Eqs. (1.10b) and 
(2.2b), 



N w =-*Tr^ 



r,F 



r,F 



3^-n q ,n p 



p r + q r 



5B_ r 



5q r 



SHr. 



-p r - 



(2.56) 



5p r Sq r 
= — i(n p — n q )H nqjnp 

Hence if H is constructed solely from monomials which have equal numbers of fermionic ^'s 
and V^' s ) so that n q = n p for all monomial terms in H, then the trace quantity N remains 
conserved. This gives the most general structural restriction on H leading to conservation 
of N. 
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As a second structural specialization, let us restrict the class of matrix models under 
consideration to those in which the only non-commuting matrix quantities are the Lagrangian 
dynamical variables q r ,q r , or their Hamiltonian equivalents q r ,p r - In other words, we shall 
assume that the trace Lagrangian and Hamiltonian are constructed from the dynamical 
variables using only c-number complex coefficients, excluding the more general case in which 
fixed matrix coefficients are used. With this restriction, we shall show that there is a generic 
conserved operator 

C = ^2[q r ,p r ] -^2{q r ,p r } = ^2x r u rs x s , (2.6) 

r,B r,F r,s 

with subscripts B, F denoting respectively sums over bosonic and fermionic operator phase 
space variables. The existence of the conserved quantity C was first discovered by Millard 
[6] under the more restrictive assumption of a bosonic theory with a Weyl ordered (i.e., sym- 
metrized) Hamiltonian, but was soon seen to hold [7,8] under the less restrictive conditions 
assumed here. 

When the Lagrangian and Hamiltonian are constructed using only c-number fixed coef- 
ficients, there is a global unitary invariance which preserves the adjointness properties of the 
dynamical variables (in the sense that writing y r = U^x r U ', then y\ = U^x\U .) That is, if 
there are no fixed matrix coefficients, then the trace Lagrangian obeys 

L[{UUrU}, {U^q r U}] = L[{q r }, {q r }] , (2.7a) 

and the trace Hamiltonian correspondingly obeys 

H[{tfq r U}, {rfp r U}\ = U[{q r }, {p r }} , (2.76) 

with U a constant unitary N x N matrix. Let us now find the conserved Noether current 
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corresponding to this global unitary invariance. Setting U = exp A, with A an anti-self- 
adjoint bosonic generator matrix, and expanding to first order in A, Eq. (2.7b) implies that 

H[{q r -[A,q r ]},{p r -[A,p r }}] = U[{q r },{p r }] . (2.8a) 

But applying the definition of the variation of a trace functional given in Eq. (1.3b), Eq. (2.8a) 
becomes 

^E(-f[A.*l-f[A.lvl)=° • < 2 '«» 
which by use of the bilinear cyclic identities of Eqs. (l.la,b) yields 

m . ^ f6H 5H 5H SH\ . . 

TrA / , l~Qr ~ £rq r - x h -^Pr - e r p r — = 0. (2.8c) 

\oq r oq r op r op r J 

Since the generator A is an arbitrary anti-self-adjoint N x N matrix, the matrix that mul- 
tiplies it in Eq. (2.8c) must vanish, giving the matrix identity 

/ , I - * - trQr^ h T~ Pr - ^rPr T~ = 0. (2.9a) 

\oq r oq r op r op r J 

But now substituting the Hamilton equations of Eq. (1.10b), Eq. (2.9a) takes the form 

= ^ (-PrQr + e r q r p r + e r q r p r - p r q r ) 

r 

= J t Y,i-Prqr + e r q r p r ) {2%) 

completing the demonstration of the conservation of C. Assigning adjointness properties 
to the fermionic variables as in Eq. (2.4b), and taking the bosonic variables q r to be self- 
adjoint (or anti-self-adjoint), which for a real trace Lagrangian implies that the correspond- 
ing bosonic p r are respectively self- adjoint (or anti-self-adjoint), we see that the conserved 
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operator C is anti-self-adjoint, 

C = -& . (2.10a) 

(A more general adjointness structure for C, corresponding to an alternative assignment 
of fermion adjointness properties, will be discussed shortly.) Also, from the bilinear cyclic 
identities of Eqs. (l.la,b), we see that C is traceless, 

TrC = . (2.106) 

Corresponding to the fact that C is the conserved Noether current in any matrix model 
with a global unitary invariance, it is easy to see [5,7] that C can be used to construct the 
generator of global unitary transformations of the Hilbert space basis. Consider the trace 
functional 

G A = TrA(7 , (2.11a) 

with A a fixed bosonic anti-self-adjoint operator, which can be rewritten, using cyclic invari- 
ance of the trace, as 

G A = -Tr^[A,p r ]g r = Tr^p r [A,g r ] . (2.116) 

r r 

Hence for the variations of p r and q r induced by using Ga as canonical generator, which by 
definition (see Eq. (2.13a) below) have a structure analogous to the Hamilton equations of 
Eq. (1.10b), we get 

sg! < 2 ' 11c > 

5q r =e r — — = [A,q r ] . 

OPr 

Comparing with Eqs. (2.7b) and (2.8a), we see that these have just the form of an infinites- 
imal global unitary transformation. 
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The generalized Poisson bracket of the trace generators of two infinitesimal global unitary 
transformations Ga and Gs can be computed [5] by combining Eq. (2.11c) with the definition 
of the bracket in Eq. (1.11a), with the result 

{G A , G s } = G [A ,E] • (2.12a) 

Hence the Lie algebra of the generators Ga under the generalized Poisson bracket is iso- 
morphic to the algebra of the matrices A under commutation. Equation (2.12a), which is 
an analog of the "current algebra" group properties of integrated charges in quantum field 
theory, can be generalized [5] to an analog of the local current algebra of quantum field 
theory as follows. Let us write 

C = C r , 

(2.126) 

and let us define a "local" trace generator GAr by 

G Ar = TrACV . (2.12c) 
Then a straightforward calculation, similar to that leading to Eq. (2.12a), shows that 

{GAr, Gss} = <5rsG[ A ,E]r . (2.12(f) 

In addition to the canonical generators for global unitary transformations given in 
Eq. (2.11c), we can also define general canonical transformations. Letting G = TrG, with 
G self-adjoint but otherwise arbitrary, a general infinitesimal canonical transformation is 
defined by 

5G 

p r -p r = 5p r =-— , 

/J" (2.13a) 

q r - q r = dq r =e r — , 
bpr 
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which is the natural extension to trace dynamics of an infinitesimal canonical transforma- 
tion in classical mechanics. In terms of the symplectic variables x r introduced in Sec. 1, 
Eq. (2.13a) can be written in the compact form 

5G 

x' r — x r = 5x r = ^ uj rs - — . (2.136) 



s s 



Letting A = A[{x r }] be an arbitrary trace functional, we find immediately that to first 

order under a canonical transformation, 

A' =A[{x' r }] 

=A + Tr > — Sx r 

^ 5x r 

(2.14a) 

r,s 

=A + {A,G} , 

that is, 

5A = A'- A = {A,G} . (2.146) 

Comparing Eq. (2.13b) with Eq. (1.15b), we see that when G is taken as Hdt, with H the 
trace Hamiltonian and dt an infinitesimal time step, then 5x r = x r dt gives the small change 
in x r resulting from the dynamics of the system over that time step. So as expected, the 
Hamiltonian dynamics of the system is a special case of a canonical transformation. 

Let us now consider canonical transformations with generators G that are global unitary 
invariant, that is, that are constructed from the {x r } using only c- number fixed coefficients. 
Global unitary invariance implies that these generators obey 

{G,G A } = , (2.15) 

with Ga the global unitary generator of Eq. (2.11a). But using Eq. (2.14b), Eq. (2.15) 
has the alternate interpretation that Ga is invariant under a canonical transformation G 
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that is global unitary invariant, and since the anti-self-adjoint matrix A is arbitrary, this 
implies that C is invariant under any canonical transformation with a global unitary invariant 
generator. (This could also have been deduced by a calculation in direct analogy with 
Eqs. (2.7a) through (2.9b).) This invariance group of C has the following significance. 
Consider a Poincare invariant trace dynamics field theory with a global unitary invariant 
trace Lagrangian, examples of which are given in Sec. 3 below. In such a theory, the 
Poincare generators will be trace functionals which are also global unitary invariant (that is, 
if the Lagrangian involves only c-number fixed coefficients, this property carries over to the 
trace energy momentum tensor and to the trace Poincare generators), and so we can conclude 
from the above discussion of canonical invariance that C is Poincare invariant. This will be 
seen explicitly in the examples given in Sec. 3, and will play a role in our later analysis of 
the emergence of quantum behavior from the statistical dynamics of global unitary invariant 
matrix models. 

For each phase space variable q r ,p r , let us define the classical part q c r -,p c r and the non- 
commutative remainder q' r ,p' r , by 



so that bosonic q^,p c r are c-numbers, fermionic q c r -,p c r are Grassmann c-numbers, and the 
remainders are traceless, 




(2.16a) 



q'r =Qr ~q C r , Pr = Pr ~ P° r 



Trq' r = Trp' r = 



(2.166) 



Then since q c r ,p c T commute (anticommute) with q' s ,p' s for r, s both bosonic (fermionic), we see 
that the classical parts of the phase space variables make no contribution to C, and Eq. (2.6) 
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can be rewritten as 

C^Efe^rl-EfcU-} • (2.16c) 

r,B r,F 

Thus C depends only on the non-commutative parts of the matrix phase space variables. 

We conclude this section by showing that the argument for the adjointness properties 
of C can be generalized, allowing for the possibility that C can have a component which is 
self-adjoint, when we allow a more general assignment of fermionic adjointness properties 
than that of Eq. (2.4b). Let us consider a trace Lagrangian which has a fermionic kinetic 
term of the form 

L kin = Tr^Ks4 , (2.17a) 

r,s 

with A rs for each r, s an N x N matrix. This trace Lagrangian will be real, up to a total 
time derivative, provided that the set of matrices A rs obeys 

A rs = -A\ r . (2.176) 

If we identify q s = ip s , then the corresponding canonical momentum is 

Ps = j- = y2^ r A rs , (2.17c) 

and the kinetic Lagrangian takes the form 

Lkin = Tr^ p s q s , (2.17d) 

s 

which is clearly global unitary invariant as a function of the phase space variables x r , even 
though L was not global unitary invariant when expressed in terms of the original variables 
■ipr, ipl- Let us now suppose that the remaining terms in L also have the property that they 
are global unitary invariant when expressed in terms of the phase space variables x r ; then 
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the trace Hamiltonian H will also be global unitary invariant. The argument of Eqs. (2.7b) 
through (2.9b), which does not make use of the adjointness assignment of Eq. (2.4b), then 
implies that C of Eq. (2.6) is still conserved. 

To see when the possibility of a self-adjoint component of C can be realized, we consider 
the fermionic part Cp, for which we have 

Cf = - ^2{q a ,Pa} = ~ ^[Mt-Ara + i^lAstps] , 

s,F r,s 

Q = ~ £[4.WJ + $4>r] (2.18a) 

r,s 

r,s 

where in getting the final line we have used the condition of Eq. (2.17b). Adding the two 
equations, we get 

C F + C) p = -Y d [MlA r8 \ , (2.186) 

r,s 

showing that when the right hand side of Eq. (2.18b) is nonzero, the operator C is no longer 
anti-self-adjoint. As a direct check that the commutator on the right hand side of Eq. (2.18b) 
is self-adjoint, we have 

(j> s ^j, A, s ])t =j2[aLa^ s ] = -Y} A sr^\\ 

(2.18c) 



r,s 



When A rs is a c-number for all r, s, then the right hand side of Eq. (2.18b) vanishes, and C 
is anti-self-adjoint. Thus, with the c-number choice 

A rs = i5 rs , (2.18(f) 

which trivially satisfies the condition of Eq. (2.17b) and corresponds to the fermion kinetic 
structure and adjointness assignment used in Eqs. (2.4a,b), we recover our earlier conclusion 
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that C is anti-self-adjoint. Throughout most of this book we shall use this simple choice of 
we shall see that an anti-self-adjoint C naturally leads to an emergent quantum dy- 
namics. However, in Section 5F, where we consider stochastic corrections to the Schrodinger 
equation, we shall allow for the possibility that C can have a self-adjoint part as well. 

As a very simple example of a nontrivial trace action that has a conserved C that is not 
anti-self-adjoint, consider 

L = Tr[-0 f A(^ + ij>B) + -B 2 ] , (2.19a) 

with A = —A^ a fixed matrix and with B = —B^ an anti-self-adjoint bosonic operator. Then 
with q F = ip , Pf = V^A an d <?b = B , ps = B, the corresponding trace Hamiltonian is 

H = Tr[-p F q F q B + X -p\\ , (2.196) 

which is a global unitary invariant function of its arguments. Thus the operator 

C =[q B ,p B ]- {q F ,p F } (2.20a) 

is conserved, as can be checked explicitly by use of the operator equations of motion 

q F = - q F q B , p F = q B p F , 

(2.206) 

4b =Pb , Pb = Pf^f ■ 
However, when A is not a c- number, the calculations of Eqs. (2.18b,c) show that C has a 

piece that is self-adjoint, 

C + &= [A, ^t] = qpppA- 1 ] . (2.21a) 

The anti-self-adjoint and self-adjoint parts of C are separately conserved, as we readily verify 
from the equations of motion of Eq. (2.21), 

-jjilFPF) = C[fPf + QfPf = . (2.216) 
at 
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We conclude this discussion by exploring the connection between time reversal nonin- 

variance and the appearance of a self-adjoint piece in C. Let us define the anti-unitary time 

reversal transformation T, in analogy with the standard definition for fermion fields, by 

TiT- 1 =-i , 

Ti> r (t)T- 1 =^2u rs Xs(-t) , (2.22a) 

s 

T4(t)T- 1 = £ u; sX t(-t) = J2 ulxt(-t) ■ 

s s 

Here U is a c-number unitary matrix, and we use the notation x instead of ip on the right 
hand side as a reminder that under a linear superposition of the ip r with complex coefficients, 
one obtains an antilinear superposition of the corresponding Xs, that is, a superposition with 
complex conjugated coefficients. With this definition, we find that the transformation of the 
expression appearing in Eq. (2.17a) for the fermionic kinetic energy is 

rfc$(f)4-.Wf) p 1 

^ r > s ' (2.226) 

= E xt(-m m A* mn u ns d t xs(-t) . 

m,n,r,s 

Hence the kinetic action f dtL^ will be form-invariant under time reversal if 

A-s = — E Ul m A* nn U ns , (2.22c) 

m,n 

which is satisfied by the simplest choice A rs = i5 rs of Eq. (2.18a). If we instead take the 
somewhat more general choice A TS = A5 rs , with A = —A^, then since U is a c-number 
Eq. (2.22c) simplifies to 

A = —A* = A T , (2.22d) 

with the superscript T denoting the matrix transpose. Hence in this case, which is the rele- 
vant one for a Dirac spinor in an irreducible group representation, with r a composite index 
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labeling the Lorentz spinor and the group representation indices, time reversal noninvariance 
occurs when A ^ A T . This implies that A cannot be a c- number, with the consequence that 
[A, J2 r VvV^] 7^ 0> an d thus C necessarily has a self-adjoint part. For more complicated 
index structures of A rs , time reversal invariance does not necessarily imply the presence of 
a self-adjoint piece in C, although both can simultaneously be present. 
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3. Trace Dynamics Models With Global Supersymmetry * 



In the preceding sections, the degrees of freedom have been indexed by a discrete index r. 
As is familiar in quantum field theory, when dealing with a continuum spacetime system with 
coordinates x and time t, the index r labels infinitesimal boxes which fill out the coordinate 
space. When the trace Lagrangian L has spacetime symmetries, there will be additional 
conserved trace quantities reflecting the presence of these symmetries. For example, in a 
Poincare invariant system, the trace Hamiltonian H and a trace momentum P form a four 
vector P' 4 , which appears as the 0/i component of a trace stress-energy tensor T^. If the 
system is additionally scale invariant, the Lorentz trace of the trace stress-energy tensor 
vanishes, i.e. = (with repeated spacetime indices summed over). If the system has a 
global supersymmetry, there will be a conserved trace supersymmetry current with a time 
independent trace supercharge Q a , which together with the trace four momentum obeys the 
Poincare supersymmetry algebra under the generalized Poisson bracket of Eq. (1.11a). In this 
section we shall illustrate some of these comments with three concrete examples, the trace 
dynamics versions [9,10] of the Wess-Zumino model, the supersymmetric Yang-Mills model, 
and the so-called "matrix model for M-theory" . These three examples are worked out using 
component field methods; we close with a short discussion of a superspace approach, and of 
the obstacles facing the construction of a trace dynamics theory with local supersymmetry. 

3A. The Wess-Zumino Model 

We begin with the trace dynamics transcription of the Wess-Zumino model. We follow 
the notational conventions of West [11], except that we normalize the fermion terms in the 
action differently, and always use the Majorana representation for the Dirac gamma matrices, 
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in which 7 1 ' 2 ' 3 are real symmetric and 7 , 27 s are real skew-symmetric. (For useful cyclic 
identities satisfied by this representation of the 7 matrices, see the text and Appendix of 
[9].) The trace Lagrangian for the Wess-Zumino model is 

L = J d 3 xTr( - \{d,Af - \{d,Bf - xi^X + \f 2 + \g 2 

- m(AF + BG - xx) ^ 

- X[(A 2 - B 2 )F + G{A, B} - 2x(A - t l5 B) x ]) , 

with A,B,F,G self- adjoint N x N matrices and with x a Grassmann 4-component column 
vector spinor, each spin component of which is a self- adjoint Grassmann N x N matrix. The 
notation x is defined by x — X T 7°) with the transpose T acting only on the Dirac spinor 
structure, so that x T is the 4-component row vector spinor constructed from the same N x N 
matrices that appear in x, and 7 is an abbreviation for 27°. The numerical parameters A and 
m are respectively the coupling constant and mass. Equation (3.1) is identical in appearance 
to the usual Wess-Zumino model Lagrangian, except that we have explicitly symmetrized 
the term G{A,B}; symmetrization of the other terms is automatic (up to total derivatives 
that do not contribute to the action) by virtue of the cyclic property of the trace. 

Taking operator variations of Eq. (3.1) by using the recipe of Eq. (1.3b), the Euler- 
Lagrange equations of Eq. (1.7c) take the form 

d 2 A=mF + \({A,F} + {B,G}-2 X x) , 
d 2 B=mG + \{-{B,F} + {A,G} + 2ixi,x) , 
7^X=TOX + A({A, X }-i{£, 75X }) , (3.2) 
F =mA + \(A 2 - B 2 ) , 

G =mB + \{A, B} . 
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Transforming to Hamiltonian form, the canonical momenta of Eq. (1.9a) are 

- • T 

Px = - XI = *X , 

PA=d A , (3.3) 
p B =d B , 
and the trace Hamiltonian is given by 



= J d 3 xTr{ 1 -lpl+pl + (VA) 2 + (VBf]- i p x ^.V X 
+ \{F 2 + G 2 ) - m XX + i^P x l°{(A - i lb B), x }) , 



(3.4a) 



in which F and G are understood to be the functions of A and B given by the final two lines 
of Eq. (3.2), and where we have taken care to write H so that it is manifestly symmetric in 

rp — * 

the identical quantities p x and i X ■ The trace three-momentum P is given by 

P = - J d 3 xTr(p A 1 VA + p B VB + p x Vx) , (3.46) 

while the conserved trace quantity N of Eq. (2.4e) and the conserved operator C of Eq. (2.6) 
are given respectively by 

N = / d 3 xTr X T X , 

\ (3-5) 
C = J d 3 x{[A,p A ] + [B,p B ] - {X,P X }) , 

with a contraction of the spinor indices in the final term on the second line of Eq. (3.5) 
understood. Equations (3.4a,b) are clearly formed from the usual field theoretic expressions 
for the Hamiltonian and three-momentum by taking the trace, and symmetrizing factors 
where this is not already implicit from the cyclic properties of the trace. Exactly the same 
procedure can be used to form the full trace energy- momentum tensor T Ufl . 
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Let us now perform a supersymmetry variation of the fields given by 

SA =ex , SB = ie75X , 

5 x =^[F + t l5 G + Yd,(A + ^B)]e , (3.6) 

5F=e^d, X , 8G = ie lb >fdrX , 
with e a c-number Grassmann spinor (i.e., a four component spinor, the spin components 

of which are lxl Grassmann matrices). Substituting Eq. (3.6) into the trace Lagrangian 
of Eq. (3.1), a lengthy calculation shows that when e is constant, the variation of L van- 
ishes. The calculation parallels that done in the conventional c-number Lagrangian case, 
except that the cyclic properties of the trace and cyclic identities obeyed by the Majorana 
representation 7 matrices [9] (see Appendix D) are used extensively in place of commuta- 
tivity/anticommutativity of the fields. When e is not constant, the variation of L is given 
by 

SL = I SxTi{ J^cV) , 

J ' (3.7a) 

J" = ~ [(Ydu + m)(A + i^B) + \(A 2 - B 2 + i l5 {A, B})} , 
which identifies the trace supercharge Q a as 

Q a = d 3 xTrJ°a 

J f j (3-76) 

= / d 3 xTr-(p x + i X T )[Wd u + m)(A + i l5 B) + \(A 2 -B 2 + i l5 {A,B})]a , 

with a a c-number Grassmann spinor, where we have again taken care to express Q Q sym- 
metrically in the identical quantities p x and %x T ■ It is straightforward to check, using the 
equations of motion and the cyclic identity, that = Tr J M is a conserved trace supercurrent, 
which implies that the trace supercharge is time independent. 

It is now straightforward (but tedious) to check the closure of the supersymmetry algebra 
under the generalized Poisson bracket of Eq. (1.11a), which for the Hamiltonian dynamics 
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of the Wess-Zumino model gives 

{Qa, Q/3} =Tr — — - — + — — — [a <-> (3)\ 

5A 5p A 5B Sp B Sx 5p x ( 38a ) 

=a 7 °/5H - cry/3 • P , 

— * 

with H and P the trace Hamiltonian and three-momentum given above. It is also easy 
to check that Q e plays the role of the generator of supersymmetry transformations for the 
dynamical variables A, B, x under the generalized Poisson bracket, since we readily find (for 
constant Grassmann even parameters a, b and Grassmann odd parameter c) 

{Tr(aA + bB + cx),Q e } = Tr(aSA + bSB + cSx) , (3.86) 

with 5 A, 5B, 5x the supersymmetry variations given by Eq. (3.6) above, after elimination of 
the auxiliary fields F, G by their equations of motion. 

3B. The Supersymmetric Yang-Mills Model 

As a second example of a trace dynamics model with global supersymmetry, we discuss 
supersymmetric Yang-Mills theory. We start from the trace Lagrangian 

L = J d 3 xTr [±F% - xYD, X + \d 2 ] , (3.9a) 

with the field strength F^ and covariant derivative constructed from the gauge potential 
A^ according to 

Ffu, =d fl A u — d u A^ + [Ap, A u ] , 

D^O =d^O + [Ap, O] (3.96) 

=>D ll F uX + D v F X r + D x F lu , = . 
In Eq. (3.9b), the potential components A^ are each an anti-self-adjoint, and the auxiliary 
field D a self-adjoint, N x N matrix, and each spinor component of x is a self-adjoint 
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Grassmann N x N matrix. The Euler-Lagrange equations of motion are 

D =0 , 

YD, X =0 , (3.10a) 
D,F^=2g 2 xYx ; 

as usual for a gauge system, the v = component of Eq. (3.10a) is not a dynamical evolution 
equation, but rather the constraint 

D e F eo = 2g 2 xi°X ■ (3.106) 
Going over to the Hamiltonian formalism, the canonical momenta are given by 

PA e = --^F oe , p x = ix T , (3.11a) 
and the axial gauge trace Hamiltonian is 

H = H4 + H X , (3.116) 



with 



1 -(9^ 2 - d 2 A x + [A, A 2 ]f - -^[(<Mi) 2 + (d 3 A 



1 Z" 00 

^os =^9 2 / ^'e(z - z')[-(PxX + X T P T X ) + D lPAl + D 2 p A2 }\ z , , 

^ </-oo 

H x = - i y rf 3 xTr(p x 7 7£J D £ x) , 
where we have taken care to write H in a form symmetric in the identical quantities p x and 
iX T , and where e(z) = 1(— 1) for z > 0(z < 0). The trace three momentum is 



p 

1 m 



3 

d 3 xTi(J2 F ^PA e +P x D m x) , (3.12) 
J e=i 
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and the conserved operator C of Eq. (2.6) is given by 

2 

C= / d 3 x(J2l A tiPA e ]-{x,P x }) , (3.13a) 
^ /? 1 



with a contraction of the spinor indices in the final term of Eq. (3.13a) understood. By 
virtue of the constraint of Eq. (3.10b), the conserved operator C can also be written as 

2 

C = - I d 3 xJ2d ePAe = - [ d 2 S e PAe , (3.136) 

J J sphere at 00 

which vanishes when the surface integral in Eq. (3.13b) is zero. The conserved trace quantity 
N of Eq. (2.4e) has the same form as in the Wess-Zumino model, 

N = J d 3 xTr X T X ■ (3.14) 

Making now the supersymmetry variations 

5 =ige-i^x , 
5 X =(^[7m,7,]^ + ^D)6 , (3.15) 
5D =ie^D^x , 

in the trace Lagrangian, with e again a Grassmann c-number, we find using cyclic invariance 
under the trace and the gamma matrix identities given in Appendix D that when e is constant, 
the variation vanishes. When e is not a constant, the variation of L is given by 

SL = I d^xTri-Pd^) , 

J . (3.16a) 

from which we construct the trace supercharge Q Q as 

Q a = J d 3 xTr^(p x + t X T )F ua [Y,l> , (3.166) 
36 



again with a a c-number Grassmann spinor. Again, it is straightforward to check, using the 
equations of motion and the cyclic identity, that J M = Tr J M is a conserved trace supercurrent, 
which implies that the trace supercharge is conserved. 

One can now verify the closure of the supersymmetry algebra under the generalized 
Poisson bracket of Eq. (1.11a), which for the Hamiltonian dynamics of the supersymmetric 
Yang-Mills model gives 



supercharge as a generator of transformations, in analogy with Eq. (3.8b), the supercharge 
in the Yang-Mills case is found to generate the supersymmetry variations of Eq. (3.15), plus 
an infinitesimal change of gauge. 



As our third example of a trace dynamics model with global supersymmetry, we consider 
the matrix model [12] that has been recently studied [13] in a string-theory context under the 
name "the matrix model for M-theory". This model, formulated in zero spatial dimensions, 
has the trace Lagrangian L given by 



with the covariant derivative defined now by D t O = d t O — i[A ,O}. In Eq. (3.18), a 
summation convention is understood on the indices i, j which range from 1 to 9; A and the 
Xi are self-adjoint N x N complex matrices, while 9 is a 16-component fermionic spinor each 
element of which is a self-adjoint N x N complex Grassmann matrix, with the transpose T 
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3C. The Matrix Model for M Theory 



L = Tr (^DtXiDtX* + iO T D t O + ^[X t , X,] [X\ X*\ + T 7i [0, X*] 



(3.18) 



acting only on the spinor structure but not on the N x N matrices, so that 9 T is simply 
the 16 component row spinor corresponding to the 16 component column spinor 9. The 
potential A has no kinetic term and so is a pure gauge degree of freedom. Finally the 7$ are 
a set of nine 16 x 16 matrices, which are related to the standard 32 x 32 matrices T M as well 
as to the Dirac matrices of spin(8), as conveniently described in [14] and obeying identities 
summarized in Appendix D. 

Starting from the trace Lagrangian of Eq. (3.18), using the definition of Eq. (1.3b) to take 
operator variations, the operator Euler-Lagrange equations of Eq. (1.7c) give the equations 
of motion of the matrix model, 

d\x i = [[x j , x*] ,Xj} + 26 T ye , 

(3.19a) 

D t 6 T =i[6 T lt ,X l ] D t 6 = i[ li 6,X*\ , 
together with the constraint that the generic conserved operator C of Eq. (2.6) vanishes in 

this model, 

C = [X\ D t Xi] - 2i9 T 9 = . (3.196) 

To transform the dynamics to trace Hamiltonian form, we define the canonical momenta p Xi 
and p e by 



(3.20a) 



5{d t 9) 

so that the trace Hamiltonian is given by 

H = Tr(p Xi a t X i +p e a t 6)-L = Tr (±p Xi Px* - \[X t , X 3 ][X\ X*\ + ip eli [9, X 1 ] + iA C^j . 

(3.206) 

Again, because p$ = i6 T , we have written the trace Hamiltonian in a form that is manifestly 
symmetric under the replacements pe — > i0 T , 6 — > — ipj . 
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Let us next consider the variation of the trace Lagrangian under the supersymmetry 
transformation defined by 

5X l = - 2e T y# = 26 T fe , 

6e = -(iD t X i >y i + ±[X i ,X*]>y ij y )e + ( > , (3.21) 

5A = - 2e T 6 = 26 T e . 
Here e and e' are 16 component Grassmann c-number spinors, that is, they are column 
vectors each of whose 16 components is an independent lxl Grassmann matrix. Using the 
cyclic trace identities of Sec. 1 and the gamma matrix properties summarized Appendix D, it 
is a matter of straightforward but lengthy calculation to verify that the trace Lagrangian is 
invariant under the transformation of Eq. (3.21) when e and e' are time independent. When 
e and e' have a time dependence, 5~L is no longer zero, but instead is given by 

5L =d t Tr[- i6 T e' + {6 T lt D t X i + \iQ T lld \X\ X>])e] 

1 (3.22a) 

+Tr [2i6 T d t e' + {26 T ll D t X l - iQ T li3 \X\ X j ])d t e] . 
This identifies the trace supercharges and Q a as 

Q' a =Ti2i6 T a , 

(3.226) 

Q a =Tr(20 T 7 ,A^ - iO T Hj[X\ X*])a , 
with a a 16-component c-number Grassmann spinor, and their conservation is easily checked 

using the equations of motion and 7 matrix identities. To check the supersymmetry algebra, 
we must first write the supercharges of Eq. (3.22b) in Hamiltonian form, symmetrized with 
respect to pe and i9 T , giving 

Q' a =Tr( Pe + i9 T )a , 

j (3.22c) 
Q a = - Tr( Pd + i9 T ) (i liPXi + -nAX\ Xi])a . 

Using the generalized Poisson bracket corresponding to the Hamiltonian structure of our 

39 



model, defined now by 



{A, B} = Tr 



( 




) 



(3.23) 



it is straightforward to evaluate the supercharge algebra, and to show that it has the expected 



The derivations of Sees. 3A,B,C have all been carried out in the component formalism, 
which requires doing a separate computation for each Poincare supersymmetry multiplet. 
However, there is a simple and general superspace argument for the results we have ob- 
tained. Recall that superspace is constructed by introducing four fermionic coordinates 9 a 
corresponding to the four space-time coordinates x^. The graded Poincare algebra is then 
represented by differential operators constructed from the superspace coordinates, and super- 
fields are represented by finite polynomials in the fermionic coordinates 9 a , with coefficient 
functions that depend on x^. To generalize the superspace formulation to give trace dynam- 
ics models, one simply replaces these coefficient functions by N x N matrices (or operators), 
and one inserts a trace Tr acting on the superspace integrals used to form the action. Then 
the standard argument that the action is invariant under superspace translations still holds 
for the trace action formed this way from the matrix components of the superfields. We im- 
mediately see from this argument why it is essential for the supersymmetry parameter e to 
be a Grassmann c-number and not also a matrix; this parameter appears as the magnitude 
of an infinitesimal superspace translation, and since the superspace coordinates and 9 a 
are c-numbers, the parameter e must be one also. The construction just given gives reducible 
supersymmetry representations, and various constraints must be applied to the superfields 



form [10]. 



3D. Superspace Considerations and Remarks 
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to pick out irreducible representations. Since these constraints act linearly on the expansion 
coefficients, they can all be immediately generalized (with the usual replacement of complex 
conjugation for c-numbers by the adjoint) to the case in which the coefficient functions are 
matrices or operators. 

The simplicity of this argument suggests that generally, for rigid supersymmetry theories 
for which there exists a superspace construction, there will exist a corresponding trace dy- 
namics generalization. The superspace argument also suggests why it has not been possible 
[15] to construct trace dynamics generalizations of local supersymmetry theories, such as su- 
pergravity. The commutator of two local supersymmetries with supersymmetry parameters 
ei and e 2 is a linear combination [11] of a local Lorentz transformation, a general coordi- 
nate transformation, and a supersymmetry transformation with supersymmetry parameter 
proportional to 

e 2 7/if , (3-24) 

with ip^ the Rarita-Schwinger gravitino field. Even if we start with ei j2 that are c-numbers, 
the new supersymmetry parameter given by Eq. (3.24) will be matrix valued in a trace 
dynamics generalization where the gravitino field ^ is matrix valued. Thus, an extension of 
the results of this section to local supersymmetries would appear to require a generalization 
of the results presented above to the case in which the supersymmetry parameter e is matrix- 
valued, rather than a c-number as assumed throughout our discussion. 
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4. Statistical Mechanics of Matrix Models 



Up to this point we have discussed matrix models as classical dynamical systems. We 
shall now start laying the groundwork for the emergence of quantum mechanical behavior 
from a matrix dynamics in which quantization is not assumed a priori. We begin this 
discussion by emphasizing that we shall not follow the traditional route [16] of canonically 
quantizing a matrix model, in which working from Eqs. (1.8) and (1.9a) one takes each 
classically conjugate matrix element pair (q r )ij and (p r )ji = dh/d(q r )ij, and elevates them 
to quantum operators that satisfy canonical commutation relations, such as (for bosonic 
degrees of freedom) 

[(Qr)ij, (q s )ki\ =[(Pr)ij, (Ps)kl\ = , 

(4.1) 

[(q r )ij,(Ps)ki} =iS rs 5ii5 jk ■ 
In this approach, each classical matrix q r , because it has iV 2 matrix elements, ends up 
spawning N 2 quantum operators. The canonical quantization approach is appropriate, for 
example, when dealing with a matrix model that arises as a discretized approximation to a 
continuum field system, or as an approximation to a many-body system with a large number 
of independent degrees of freedom. In these cases, the matrix elements each represent a 
degree of freedom to which, assuming that one is dealing with a quantum field or a quantum 
many body system, the usual quantization rules apply. To repeat, this is not what we 
shall do, because we are not assuming that quantum theory applies at the underlying trace 
dynamics level. 

Instead, we shall require that the only matrix (or operator) structure present is that 
which is already present in the classical matrix model [17]. Thus, each q r and each p r cor- 
responds to a single operator degree of freedom, and these degrees of freedom do not obey 
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any simple commutation algebra: in general for bosonic degrees of freedom, [q r ,q s ], [p r ,Ps], 
and [qyjPs] wm an be nonzero, and similarly when fermionic degrees of freedom are included, 
with anticommutators replacing commutators as appropriate. However, we shall argue that 
in the statistical dynamics of matrix models with a global unitary invariance, within ther- 
modynamic averages over polynomials of the g's and p's, the matrix variables q r and p s obey 
(when a specific approximation is made) an effective commutator/anticommutator algebra 
of the familiar canonical form. In other words, we shall show that quantum behavior is an 
emergent feature of the statistical mechanics of a particular class of matrix models, with 
each matrix variable pair q r , p r corresponding to one quantum mechanical operator degree 
of freedom. The first step in such a program is to set up the statistical mechanics of matrix 
models, and that is what we shall do in this section. 



We begin our statistical treatment of matrix models by deriving [7] an analog of the 
Liouville theorem, which states that the matrix model trace dynamics leaves a suitably 
defined phase space volume element invariant. We shall actually derive a more general 
result, showing that the phase space volume element is invariant under the general canonical 
transformations introduced in Eqs. (2.13a,b), of which the trace Hamiltonian dynamics is a 
special case. 

Following the notation of Sec. 1, we denote the general matrix element of the operator 
x r by (x r ) mn , which can be decomposed into real and imaginary parts according to 



where (av)mn with A = 0, 1 are real numbers. If for the moment we ignore adjointness 
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4A. The Liouville Theorem 




(4.2a) 



restrictions, the natural phase space measure is defined by 

dji = Y\ d/j, A , 



(4.26) 



dfi A = ] [ d(x r ) 



) A 

Imn i 

r,m,n 



when adjointness restrictions are taken into account, certain factors in Eq. (4.2b) become 
redundant and are omitted. Our strategy is first to ignore adjointness restrictions and to 
prove the canonical invariance of each individual factor dji A in the first line of Eq. (4.2b), 
and then to indicate how the argument is altered when adjointness restrictions are taken 
into account. 

Under the general canonical transformation of Eq. (2.13b), the matrix elements of the 
new variables x' r are related to those of the original variables x r by 



(x'^ A 



\ ux s/ mn 



Inserting a complete set of intermediate states into the fundamental definition 

5G = TrY^-5x s , (4.36) 



Sx s 

s s 



and using the reality of G, we get 



SG = E eA (|r) A ^rn , (4.3c) 



where e° = 1 and e 1 = —1. Thus, we see that 



riGY 1 A dG 



e 



^ X sJ ran ^( X s)n m 



(4.3d) 



a result that can also be obtained by decomposing Eq. (1.8) into real and imaginary parts. 
Equation (4.3d) allows us to rewrite Eq. (4.3a) in terms of conventional partial derivatives 
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of the total trace functional G, 

dG 

Wr)L = ML + Y, u " eA wz \a • ( 4 - 3e ) 

s °\ x s)nm 

Differentiating Eq. (4.3e) with respect to (av)m'n'> we § e ^ f° r the transformation matrix 

Since for an infinitesimal matrix 5X we have det(l + SX) ~ 1 + Tr5X, we learn from 

Eq. (4.4) that the Jacobian of the transformation is 

J =1 + 2 , 

d 2 G ■ (4.5a) 



s = E 



A 



d ( X s)nm d ( X r)mn 

Interchanging in the expression for £ in Eq. (4.5a) the summation indices r and s, and also 
interchanging the summation indices m and n, we get 

s = E ^-^ V Jgt u • ( 4 - 5& ) 

rsmn u \- L r ) m n u \- h s) nm 

However, now using the fact that for bosonic r, s we have 

(jj sr ^-Vs 5 

d 2 G d 2 G ( 4 - 5c ) 

^( X r)mn^( X s)nm ^( 2 's)nm , ^( a ''")mn 

while for fermionic r, s we have 

<9 2 G d 2 G ( 4 - M ) 



9(a: r )^ ri (9(x s )4 n ^(^sjnm^^rjmn 

we see that Eqs. (4.5a-d) imply that £ = — £; hence £ vanishes and the Jacobian of the 
transformation is unity. 

Now let us see how this argument is modified when we take the adjointness restrictions on 
the phase space variables x r into account. Inspection of the argument just given shows that 
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the diagonal (m = n) and off-diagonal (m ^ n) terms in the sum E vanish separately, and for 
each of these, the summed contribution from the canonical coordinate and momentum pair 
q r , p r for each fixed r also vanishes separately. This observation permits us to readily take the 
adjointness restrictions into account; in the following discussion we shall write d\i = dfiBdfiF, 
with dfi B and dfip respectively the bosonic and fermionic integration measures. 

For a bosonic pair of phase space variables q r ,p r , the x r variables are independent but 
are both self-adjoint, and thus 

ML = e A (x r )i n . (4.6a) 

This means that the integration measure must be redefined to include only the factors that 
are real diagonal in m,n (the imaginary diagonal ones are identically zero), and only the 
upper diagonal off-diagonal factors (since the lower diagonal ones are related to the upper 
diagonal ones by complex conjugation), so that the bosonic integration measure becomes 

dfi B = Y[d(x r )° mm 11 d{xr)L . (4.66) 

r,m r,m<n,A 

The argument for the diagonal terms in this product proceeds just as did that for the diagonal 
terms in the unrestricted case, while the argument for the off-diagonal terms differs from 
that in the unrestricted case only by inserting a factor of | in front of E in Eq. (4.5a) and 
the subsequent equations that follow from it, which has no effect on the argument for the 
vanishing of E. 

For a fermionic pair of phase space variables constructed according to the recipe q r = 
ip r , p r = iipl = iq\ of Eq. (2.4b), the x r variables are no longer independent. However, this 
construction implies that 

(lr) mn = (Pr) nm 5 (Pr) mn = (lr) n m 5 (4.7a) 
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and thus the fermionic integration measure must be redefined as 

dp F = J] d(x r )° mn . (4.76) 

r,m,n 

The argument, for both the diagonal and the off-diagonal factors in m, n then proceeds just 
as in the unrestricted case, again apart from insertion of an irrelevant factor of \ in front of 
£ in Eq. (4.5a) and the subsequent equations that follow from it. 

To summarize, we have shown that the matrix operator phase space integration measure 
d\x is invariant under general canonical transformations. As noted at the beginning of this 
section, an important corollary of this result follows when G is taken as the generator dtH of 
an infinitesimal time translation, since we then learn that d\i is invariant under the dynamical 
evolution of the system, giving a trace dynamics analog of Liouville's theorem of classical 
mechanics. Since no restrictions on the form of the generator G were needed in the above 
argument for the invariance of dfi, the argument applies even when G is formed from the 
operator phase space variables using operator coefficients. Thus, the integration measure d\x 
is invariant under a unitary transformation on the basis of states in Hilbert space, the effect 
of which on the variables {x r } can be represented by Eqs. (2.11a-c). (Note, however, that 
this transformation is not itself global unitary invariant (cf. Eq. (2.12a)), and so is only a 
covariance, rather than an invariance, of the conserved operator C.) 

4B. The Canonical Ensemble 
The matrix equations of motion of trace dynamics determine the time evolution of the 
matrix g's and p's at all times, given their values on an initial time slice. However, these initial 
values are themselves not determined. We shall now make the assumption that for a large 
enough system, the statistical distribution of initial values can be treated by the methods of 
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statistical mechanics. Specifically, we shall assume that the a priori distribution of initial 
values is uniform over the unbounded matrix operator phase space, so that the equilibrium 
distribution is determined solely by maximizing the combinatoric probability subject to the 
constraints imposed by the generic conservation laws. Liouville's theorem implies that if the 
assumption of a uniform a priori probability distribution is made at one time, then it is valid 
at all later times, assuring the consistency of the concept of an equilibrium ensemble. We do 
not propose to address the question of how the randomness in the initial value distribution 
arises: it could come from a random initial condition, an ordered initial condition followed 
by evolution under a chaotic and effectively ergodic dynamics, or some combination of the 
two. 

More specifically, let d\i = d/i[{x r }] denote the operator phase space measure discussed 
in detail in the preceding section. In what follows we shall not need the specific form of this 
measure, but only the properties that it obeys Liouville's theorem, and that the measure is 
invariant under infinitesimal matrix operator shifts Sx r , that is 



(This property will be used later on, when we discuss the equipartition or Ward identities.) 
For a system in statistical equilibrium, there is an equilibrium distribution of matrix initial 
values p[{x r }], such that 



is the infinitesimal probability of finding the system in the operator phase space volume 
element d/i, with the total probability equal to unity, 



d/i[{x r + 5x r }} = dfj,[{x r }] 



(4.8) 



dP = dfj,[{x r }]p[{x r }] 



(4.9a) 




(4.96) 
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The first task in a statistical mechanical analysis is to determine the equilibrium distribution 
P- 

Since equilibrium implies that p — 0, the equilibrium distribution can depend only on 
conserved operators and total trace functionals. In the generic case for a matrix model that is 
global unitary invariant, we have seen in Sees. 1 and 2 that, in addition to the conserved trace 
Hamiltonian H (which we assume to be bounded from below), there is a conserved operator 
C, which is anti-self-adjoint when fermionic adjointness is assigned as in Eqs. (2.4b) and 
(2.18d). If the model is assumed to be constructed in a way that balances fermionic g's and 
p's, there is additionally a conserved trace "fermion number" N. When the discrete mode 
index r labels infinitesimal boxes in a spatial manifold, and the model is Lorentz invariant 
on this manifold, there will also be a locally conserved trace stress-energy tensor T MI/ , from 
which one can obtain by spatial integration not only the conserved trace Hamiltonian, but 

— * — * 

also conserved trace generators for three-momentum P, total angular momentum J, and 
Lorentz boosts K. 

We shall assume henceforth a statistical ensemble that is at rest and is not rotating, 
so that P = J = 0. Hence the distribution function has no dependence on P and J, and 
the Lorentz invariant trace mass [P° 2 — P 2 ] 5 reduces to its rest frame value H. Since the 
ensemble picks out a preferred frame, which we tentatively identify with the frame in which 
the cosmological black-body radiation is isotropic, it is clearly not Lorentz invariant, even 
when (as we shall always assume) the underlying trace dynamics action and equations of 
motion are Lorentz invariant. 

(We shall later argue that the Lorentz invariance of the emergent quantum field theory 
is a reflection of a very weak dependence of low energy physics on H, together with the fact 
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that C, by virtue of its invariance under global unitary invariant canonical transformations 
that generate Lorentz transformations of the trace action, is Lorentz invariant.) For the time 
being we shall allow a possible dependence of the ensemble on N. With these assumptions, 
the general equilibrium distribution has the form 

p = p(C*,H,N) . (4.9c) 

In addition to its dependence on the dynamical variables, p can also depend on constant 
parameter values, with the functional form of p and the values of the parameters together 
defining the statistical ensemble. Including a traceless anti-self-adjoint operator parameter 
A and real number parameters r and 77, which correspond to the respective structures of C, 
H, and N, the general form of the equilibrium ensemble corresponding to Eq. (4.9c) is 

p = p(C,\;Il,T;N,r ] ) . (4.9d) 

In the canonical ensemble, we shall see that the dependence on C and A is only through the 
single real number TrAC*, and so specializing to this case, Eq. (4.9d) becomes 

p = p(Tr\C; H, r; N, 77) . (4.9e) 

We shall now show that some significant consequences follow from the general form of 
Eq. (4.9e), together with the assumption that H is constructed from the operators {x r } 
using only c-number coefficients (as needed to insure its global unitary invariance). For a 
general operator O, let us define the ensemble average (C)av by 

<0>av = ^ ■ (4.10.) 

Then when O is constructed from the {x r } using only c-number coefficients, the ensemble 
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average (0)av must have the form 



(0) A y = F (X) , (4.106) 

with the function Fq constructed from its argument using only c-number coefficients (in 
which we include the r and r\ dependence). As a consequence, the ensemble parameter A 
commutes with (0)av, 

[A,<0) av ] = O . (4.10c) 

Let us now exploit the fact that the anti- self-adjoint operator A can always be diagonal- 
ized by a unitary transformation on the basis of states in Hilbert space, which we have seen 
is also an invariance of the integration measure dfj,. Specializing to O — C, the functional 
relationship of Eq. (4.10b) between A and (C')av then implies that (C')av is diagonal in this 
basis as well. This brings (C')av mto the following canonical form, written in terms of a 
"magnitude" operator D c s and a unitary "phase" operator i e s: 

(C)av = iesDeS , Tr (ieff-Dcff) = , i cS = , — -1 , 

(4.11a) 

[i e s, D e g] = , D c s real diagonal and non — negative . 
Although the case of general D eS , which corresponds to an ensemble that is asymmetrical 
in the Hilbert space basis, is interesting, we shall restrict ourselves henceforth to the special 
case in which D c s is a real constant times the unit operator. In other words, we assume 
that the ensemble does not favor any state in Hilbert space over any other, as a result of 
initial conditions for the underlying dynamics (which presumably arise at the origin of the 
universe in the "big bang".) Since we shall see in Sec. 5 that this real constant, which has the 
dimensions of action, plays the role of Planck's constant in the emergent quantum mechanics 
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derived from the canonical ensemble, we shall denote it by h, and so we have 

(C)av =icsh , 

(4.116) 

Tri eS =0 . 

Since the relations i c s = —i\ s and = —1 imply that i e s can be diagonalized to take 
the form idiag(±l, ±1, ±1), Eq. (4.11b) implies that the dimension N of the underlying 
matrix Hilbert space must be even, say N = 2K, and therefore i e % diagonalizes to the form 

ieff = idiag(l, -1,1,-1, ...,1,-1) . (4.11c) 

The restriction to even N is a direct result of our assumption that the magnitude matrix 
-D e ff in Eq. (4.11a) is a multiple of the unit matrix; if one were to start off with a matrix 
space with N odd, then Tr(i eff D eff ) = from Eq. (4.11a) would require D eS to have one null 
eigenvalue, since a one dimensional traceless matrix must vanish. 

We turn now to the calculation of the functional form of p in the canonical ensemble, 
which is the ensemble relevant for describing the behavior of a large system that is a sub- 
system of a still larger system. The form of p is determined [18] by maximizing the entropy, 

S = - J dpplogp , (4.12a) 

subject to the constraints 

J dpp =1 , 
/ dppC =(C) AV , 

7 (4.126) 
dppK =(H) AV , 



J dppN=(N) AV . 



The standard procedure is to impose the constraints with Lagrange multipliers 6, A, r, 77 by 
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writing 

jF=y dpp\ogp + 9 J dfip+ J d/ipTrXC + T J dppH + r] J dppN , (4.13a) 

and maximizing — T (or equivalently, minimizing J 7 ), treating all variations of p as indepen- 
dent. Varying Eq. (4.13a) with respect to p then gives 

p = exp(— 1 — 6 — TrXC — rH — 77N) , (4.136) 

which on imposing the condition that p be normalized to unity gives finally 

p =Z- X exp(-TrAC' - rH - 77N) , 

f . . (4.13c) 

Z= ^exp(-TrAC - rH - r]N) . 

From Eq. (4.13c) we can derive some elementary statistical properties of the equilibrium 
ensemble. For the entropy S, we find 

S = -<logp) AV = logZ + Tr~X(C) AY + r(H) AV + ??(N> AV . (4.14a) 

Since the ensemble averages which appear in Eq. (4.14a) are given by 

5logZ 



(C) 



AV 



(H> AV = -^, (4.146) 
W - dl ° gZ 

(n)av "-^T' 

Eq. (4.14a) takes the form 

S = \ogZ - TrA— ^ r— r]— . (4.14c) 

5X dr dr] 

Thus the entropy is a thermodynamic quantity determined solely by the partition function. 
Taking second derivatives of the partition function, we can similarly derive the thermody- 
namic formulas for the averaged mean square fluctuations of the conserved quantities C, H, 
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and N, 

A 2 TiPd = ((TrPC - (TrPC% v ) 2 >Av = ((TrP&) 2 ) AW - (TrPC) AY = (TrP-l) 2 logZ , 

oA 

A 2 , =((H - (H)av) 2 )av = (H 2 ) AV - (H)| v ()2li)gZ 



(dr] 



2 



A 2 , =<(N - (N) av ) 2 )av = (N 2 ) AV - (N) AV = , 

(4.14d) 

with P an arbitrary fixed anti-self-adjoint operator. Similar expressions hold for the cross- 
correlations of TrPC, H, and N, for example 

((TrPC- (TrPC) av)(H-(H)av))av = (TrPCH) AV -(TrPC) AY (H) AV = TrP^-logZ . 

(4.14e) 

The complete set of such relations, in a more compact notation, is given in the next section. 

As a final remark, we note that in subsequent sections we shall follow the conventional 
practice of introducing for each matrix variable x r a matrix source j r , of the same bosonic 
or fermionic type and with the same adjointness properties as x r , which can be varied and 
which is then set to zero after all variations have been performed. With the sources included, 
the equilibrium distribution and partition function take the form 

p =Z~ l exp(-TrAC' — rH — r\N — ^ Trj r x r ) , 

, r (4.15a) 

Z = dfi exp(-TrAC' - rH - r]~N - Trj r x r ) . 

J r 

Continuing to use the expression (O)av to denote the average of a general operator over the 
equilibrium distribution of Eq. (4.15a) which includes sources, the variations of logZ with 
respect to its source arguments are related to the averages of the x r by 

€r{Xr)jw = J_^l . (4.155) 
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4C. The Micro canonical Ensemble 

In the previous section, we derived the canonical ensemble for trace dynamics by max- 
imizing the entropy subject to the generic constraints, which were imposed in an averaged 
sense. In this section, we shall give [5] an alternative and more fundamental derivation of the 
canonical ensemble, by starting from the microcanonical ensemble, in which the constraints 
are imposed in a sharp sense. We shall see that the canonical ensemble then arises as the 
appropriate description of a large system in equilibrium with a much larger "bath", with 
the equilibrium conditions determining in an intrinsic manner the ensemble parameters, or 
generalized "temperatures" A, r, and rj. Apart from using the microcanonical ensemble to 
derive the canonical ensemble in this section we shall not employ the microcanonical ensem- 
ble further in our subsequent analysis. The reason for our primary focus on the canonical 
ensemble is that the Ward identities that imply emergent quantum behavior, which are 
derived in Sec. 5, are properties of the canonical ensemble, but not of the microcanonical 
ensemble. Thus, if the microcanonical ensemble is taken to represent the entire universe, 
our subsequent analysis suggests that emergent quantum mechanics is a property only of 
subsystems of the universe that are large but still appreciably smaller than the universe as 
a whole. 

It is convenient at this point to introduce a condensed notation for the exponent appear- 
ing in the canonical ensemble of Eq. (4.13c), which takes the anti-self-adjointness of C and 
A into account. Writing as in Eq. (4.2a), 

(C)mn ={C) Q mn + i{C) l rnn , 

(4.16a) 

(A)mn = (X) mn + i(\) mn , 
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the anti-self-adjointness restrictions on C and A take the form 

(C) mn = -e A (C)L, (A)L = -e A (A)L , (4.166) 
with e° = 1 and e 1 = — 1 as before. Then a simple calculation shows that 

tt\c = - J2WUc)L - 2 [(A)L(<?)L + (A)L(COLJ , (4.1&0 



n<m 



with all the terms on the right hand side independent. It is now convenient to introduce a 
vector notation for the exponent in Eq. (4.13c), by defining 
£=(£\-,£ M ) 

=(H, N, \{C) l nn) n = 1, N], [((7)L, n < m = 1, .., iV], [((7)^, n < m = 1, N]) , 

=(r, 77, -[(A)^, n = 1, AT], -2[(A)° m , n< m = 1, N], -2[(A)L, n < m = 1, N}) , 

(4.17a) 

which permits us to write 

TrAC* + rH + r]N = & ■ i ■ (4.176) 

— * 

In other words, £ is the vector of all the real number generic conserved quantities, and 
a is the vector of the corresponding canonical ensemble parameters (which are analogs of 
the inverse temperature parameter (3 and the chemical potential parameter \i of ordinary 
statistical mechanics). The dimensionality M of both vectors is M = 2 + A^ 2 . 

We can now introduce the microcanonical ensemble T(H), which is defined as the volume 
of the shell of phase space for the "universe" in which the conserved quantities take the sharp 

— * 

values S. In other words, we write 

/M 
dfil[5(E a -C) , (4.18a) 
a=l 
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which has an associated entropy 

5(S)=lo g r(S) . (4.186) 

Let us now divide the universe into a "system" s, which is still large in a statistical sense 
but is much smaller than the universe, and a "bath" b which is the complement of degrees 
of freedom in the universe not included in the system. We now assume that the vector of 
conserved quantities £ is to a good approximation additively decomposable over the system 
and the bath, when both are very large. In other words, we assume that 

C-is + ib , (4.19a) 

— * — * 

with £ s and the values of the conserved quantities appropriate to the system and to the 
bath, respectively. Note that if the system and bath are defined simply by a partitioning 
of the canonical degrees of freedom q r ,p r , additivity is automatic for N and C, which are 
additive sums over the degrees of freedom, but not for H, which in general has nonlinear 
interactions between the degrees of freedom. Letting d/i s and d/ib be the phase space measures 
for the system and the bath, so that dji ~ d/j, s d/j,b, and introducing a dummy variable of 
integration E s , we can rewrite Eq. (4.18a) as 



r(s) = Ij/ds;r 6 (s-s.)r - (s - ) , 



(4.196) 



with the system and bath microcanonical subensembles defined by 

M 



J a=l 
» M 

J o=l 



(4.19c) 



We now assume that the integrand in Eq. (4.19b) has a maximum that dominates the 
integral when the number of degrees of freedom is large. Although we give no a priori 
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justification of this assumption, we shall later on show that it is self-consistent. The necessary 
condition for the integrand in Eq. (4.19b) to have an extremum at E s = X s is 

JL[T b 0-E s )T s s )}\x a =U , (4.20a) 

which can be rewritten as 

a a ^^logr s (S s )|^ = Alogr b (S-S s )|^ . (4.206) 

Thus, at the assumed maximum, the logarithmic derivatives in Eq. (4.20b) define a set 
of equilibrium parameters a common to the bath and the system. Recalling the entropy 
definition of Eq. (4.18b), we can rewrite the bath phase space volume at the extremum as 



r 6 (S - X s ) = exp(S b (E - X s )) ~ exp(S b 0)) exp ^- A lo g r 6 (S) j , (4. 



20c) 



which neglecting a small shift from S — X to S in the definition of the equilibrium parameters 
a, gives us 

T b (E - X s ) ~ exp(S h (E)) exp(-a ■ X) . (4.20d) 

Renaming the free parameter X s in Eq (4.20d) as S s , we deduce from this equation that 

T b - E s ) ~ exp(5 b (S)) exp(-a • E s ) . (4.20e) 

Returning now to Eq. (4.19b) and substituting the approximate form of Eq. (4.20e) for 
the bath phase space volume factor, we get 

r(S) ~ exp(S b (E))Z s , (4.21a) 

with Z s the integral defined by 

Zs = Uf dE a s exp(-a-E s )T s (E s ) . (4.216) 
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On substituting Eq. (4.19c) for the system phase space volume T S (S S ) and carrying out the 
integration over the dummy variables S", we can rewrite Z s as 



/ 



d(i, s exp(-a ■ Q . (4.21c) 



We conclude that when the system and bath are in equilibrium, and the overall "universe" 
comprising the system and bath is in a microcanonical ensemble, the system variables are 
weighted in the phase space integral according to the normalized distribution 

p s = Z; 1 exp{-a ■ C) , (4.22a) 

which defines the standard canonical ensemble. Since all of the above manipulations go 
through if d/i s is replaced by dfi s f s , with f s any function of the system variables, we have 
shown that the average (/ s )av defined in the microcanonical ensemble, 



/a>nf =1 o(s a -m 
j>nf =1 <Ks a -e)i 



{Ts)av = - , M — — j-^r (A.26a) 



can be equivalently calculated as 

(/ S ) AV ~ J d^ sPs f s . (4.236) 

This justifies the use of the canonical ensemble in calculating thermodynamic averages of 
system quantities. 

As a consistency check on the calculation, we must verify that within our approximations, 
the extremum of Eq. (4.20a) is a maximum. Using the approximated form of the integrand 
in Eq. (4.21b), the condition for an extremum is 

3+ logl^S,)] = • (4.24a) 



"a 
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In other words, 



a a = ^-\ogT s (E s ) , (4.246) 



"a 



in agreement (at E s = X s ) with the definition of Eq. (4.20b). In order for the extremum to 
be a maximum, the matrix of second derivatives 

|4logr s (S s ) = !v (4.24c) 

'— 's "a '- 's 

must be negative definite. This will be true provided that the inverse matrix dE®/dcr b is 
negative definite (and bounded), with S" the location of the maximum of the integrand in 
Eq. (4.21b), which for a large system is closely approximated by the canonical ensemble 
average of But from Eq. (4.21c), we see that 

d\ogZ s 



da a 

and differentiating again, 



= <C>av , (4.25a) 



dHogZ s _d(C)Av _ ,„„ ,„, ,„,, „,, 



da a da b da b 



= -((C-(C>av)(C-(Oav)>av , (4.256) 



which is negative definite and bounded. Thus the assumption that the extremum in the phase 
space integral is a maximum is self-consistent. Referring back to the correlation formulas of 
Eq. (4.14e), we see that Eq. (4.25b) gives the most general such formula in our condensed 
notation. 

4D. Gauge Fixing in the Partition Function * 
Up to this point, in discussing the statistical mechanics of trace dynamics we have 
assumed that one is dealing with an unconstrained system, leading to the generic form of 
the canonical ensemble given in Eq. (4.13c). In order to apply Eq. (4.13c) directly to a 
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constrained system, one must first explicitly integrate out the constraints. A simple example 
where this is possible is provided by the trace dynamics transcription of supersymmetric 
Yang-Mills theory, discussed in Sec. 3B. (Further examples of gauge invariant trace dynamics 
models are given in Appendix E.) In axial gauge, where A 3 = 0, the covariant derivative 
D 3 simplifies to D 3 = <9 3 , allowing the constraint of Eq.(3.10b) to be integrated out, giving 
the explicit expression for the trace Hamiltonian of Eqs. (3.11b,c) and the corresponding 
expression for the conserved operator C of Eq. (3.13a). The axial gauge partition function 
is then given by Eq. (4.13c), with the phase space measure d/i given by 



The problem addressed in this section is how to generalize the axial gauge partition 
function to other gauges in which it may not be possible to explicitly integrate out the 
constraint [19]. The problem of correctly incorporating a gauge invariance group with a 
continuous infinity of group parameters and an infinite invariant group volume is a familiar 
one in the theory of path integrals, and we shall use methods similar to the ones employed 
there to give a solution. However, since the partition function singles out a Lorentz frame, 
we will have to make a restriction not encountered in the Lorentz scalar path integral case, 
namely we will consider only nontemporal gauge conditions that do not involve the scalar 
potential A . This still allows us to consider gauge transformations that rotate the axial 
gauge axis, or that transform to rotationally invariant gauges such as Coulomb gauge. We 
shall also make the further assumption that the allowed gauge transformations leave invariant 
the surface integral which, according to Eq. (3.13b), determines C, thus placing a restriction 
on the gauge transformation at the point at infinity. We proceed by developing an analog 
of the standard De Witt-Faddeev-Popov method to write the axial gauge partition function 
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2 




(4.26) 



in a general nontemporal gauge, subject to the surface term restriction just stated. Since 
we have seen in Sec. 3 that trace dynamics incorporates rigid super symmetry, and since 
BRST invariance is a particular rigid supersymmetry transformation, we shall find that the 
generalized expression for the partition function, when reexpressed in terms of ghost fermions, 
admits a BRST invariance. As in our preceding discussion, we assume convergence of the 
partition function, which may well require restrictions on the class of trace Hamiltonians 
being considered. 

To express the partition function in a general nontemporal gauge, we follow closely the 
treatment of the De Witt-Faddeev-Popov construction in the familiar functional integral 
case, as given in the text of Weinberg [20] . Let us consider the integral 

Z G = J dfiB[f(A e )]5(Y) detF[A e ] exp(-rH - Tr\C) , 

3 (4.27a) 

d ^ = n n d M%) d PA e (x) , 

s e=i 

with C given by Eq. (3.13b) and with the constraint Y given by 

3 

Y = J2DePA e + 2xi°X ■ (4-276) 
e=i 

The trace Hamiltonian H in Eq. (4.27a) is given by Eq. (3.11b), with the gauge part Ha 
given by 

^ = / - h E F L) > (4-27c) 
J i=i y £,m=l 

which is valid in a general gauge on the constraint surface Y = selected by the delta 
function in Eq. (4.27a). The delta function of the anti-self- adjoint matrix valued argument 
Y appearing in Eq. (4.27a) is given, in terms of ordinary delta functions of the real (R) and 

62 



imaginary (/) parts of the matrix elements, by 



S(Y) = ]J 5{{Y R ) mn ) ] [ o((Y» mn ) 



(4.28a) 



m<n m<n 



and the integration measure over the anti-self-adjoint matrix At is defined by 



dA e = ] [ d(A m ) mn Yl d(A u ) 



mn 



(4.286) 



m<n m<n 



and similarly for dpA r The function B[f] is an arbitrary integrable scalar valued function of 
the matrix valued argument f(Ai), which is used to specify the gauge condition. We shall 
treat / as a column vector f a with a a composite index formed from the matrix row and 
column indices m, n; the argument T of the De Witt-Faddeev-Popov determinant is then 
given in terms of / by the expression 



where 5 is the usual functional derivative and (3 is the composite of the row and column 
indices of the infinitesimal gauge transformation matrix A. 

We now demonstrate two properties of the integral Zq defined in Eq. (4.27a): (i) first, we 
show that when the gauge fixing functions B[f] and f(A e ) are chosen to correspond to the 
axial gauge condition, then Eq. (4.27a) reduces (up to an overall constant) to the axial gauge 
partition function; (ii) second, we show that Zq is in fact independent of the function f(Ag), 
and depends on the function B[f] only through an overall constant. These two properties 
together imply that Z G gives the wanted extension of the axial gauge partition function to 
general nontemporal gauges. 

To establish property (i), we make the conventional axial gauge choice 



3~y otx,/3y[Ae] 



A=0 



(4.28c) 



B[f(A e )} = 5(A 3 ) = Jl 5((A 3R ) mn ) H 5((A 3I ) mn ) 



(4.29a) 
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so that 

J dA 3 B[f(A e )} = J dA 3 5(A 3 ) = 1 . (4.296) 

With this gauge choice, 

D 3 p A:i = d 3 p A3 , (4.29c) 

which implies that 

2 

8(Y) =5(d 3 p Aa + D ®A t + 2xi°x) 

£=1 2 (4.29d) 

=|^|-M(p^ + i / dz'e(z - z')C£D ePAi + 2X7°X)) ■ 
J 1=1 

Hence the integral over p Az in Z G can be done explicitly, giving (up to an overall constant 
factor coming from the Jacobian l^l -1 ) the expression 

Z G = yV xial exp(-rH - TrAC)| A3=0; pA __ , J dz , <z - z , )(L \ =1 d iPAi+ 2^ x) » ( 4 - 30 ) 

which agrees (recalling from Eq. (3.3) that 2x7°x = —(p x X + X T Px)) with the axial gauge 
partition function constructed from of Eq. (3.11c). 

To establish property (ii), we first examine the gauge transformation properties of the 
various factors in the integral defining Z G . We begin with the integration measure d\i. Under 
the infinitesimal gauge transformation (with A anti-self-adjoint) 

A t -> A, + D e A = A e + d e A + [A e , A] , (4.31a) 

the inhomogeneous term deA does not contribute to the transformation of the differential 
dA e . Therefore dAe obeys the homogeneous transformation law dAe — > dAg + A^, with 

A e =[dAe,A] . (4.316) 
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Hence to first order in A, the Jacobian of the transformation (calculated by the same rea- 
soning that led from Eq. (4.4) to Eq. (4.5a)) is 

j =1 d{A m ) mn d{A n ) 

rnn 

^ n d(dA m ) mn ^ d(dA ei ) mn 

=1 + (£ + E)[( A «)- - ( A «)-™] (431c) 

m<n m<n 

= 1 , 

since the anti-self-adjointness of A implies that (A R ) nm = —(A R ) mn , and so the diagonal 
matrix elements (A R ) nn are all zero. Thus each factor dAg(x) in the integration measure 
is gauge invariant. A similar argument applies to each factor dpA e (x) in the integration 
measure, and also to the factor 5(Y) in the integrand, since Y obeys the homogeneous gauge 
transformation law Y — > Y + [Y, A] . Turning to the exponential, the terms Trp^ and Tr Fg m 
are gauge invariant, and so the trace Hamiltonian H is gauge invariant. By hypothesis, the 
surface term determining C is left invariant by the class of gauge transformations under 
consideration. To summarize, we see that the integral Zq has the form 

Z G = J dng[A e ]B[f(A e )]detF[A e ] , (4.32a) 

with the integration measure d\i and the integrand factor 

Q[At\ = 5(Y) exp(-rH - TrXC) (4.326) 

both gauge invariant. Hence Zq has exactly the form assumed in the discussion of Weinberg 
[20], and the proof given there completes the demonstration of property (ii). 

Continuing to follow the standard path integral analysis, let us represent the De Witt- 
Faddeev-Popov determinant det T\Ai\ as an integral over fermionic ghosts, by writing 

det T[A(\ = J du*dujexp(J d 3 xd 3 yujl(x)J 7 aS! / 3 $[At]ujp(y)) , (4.33a) 
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with 

dU = II II duJ "in{x) , du* = Yl Yl duj mn(x) 
x m,n x m,n 

Let us also take for B[f] the usual Gaussian 

B[f] = exp(-^ J d 3 xTrf(A e (x)) 2 ) , 
and for f(Ai) the linear gauge condition 



(4.336) 



(4.33c) 



(4.33d) 



in which L e can be either a fixed vector (such as in axial gauge) or a differential operator 

(such as de in Coulomb gauge), and a summation of £ from 1 to 3 is understood. With this 

choice of f{Ae), we find from Eq. (4.28c) that 
5f nm (A e (x)+D e A(x)) 



•F nmx,pgy[^£ 



5A 



pq\ 



= y~]Li[ ^ — SnpSmq + S(x - y) [(A e ) np 8 mq - 5 np (A e ) qm ] 



(4.34a) 



which when substituted into the exponent in Eq. (4.33a) gives, after integrations by parts, 
j ' d 3 xd 3 yu* a fflF aSM [Ae]My) = J d 3 xTrcu(x)J2 LeD ^(x) , (4.346) 
where we have defined ZJ mn = oo^ m . Hence the expression of Eq. (4.32a) for Z G becomes 

Z G = j dfidudujg[A e ]exp - J d 3 xTr I ^-(J^L%) 2 -ZJ{x)^2L e D e uj{x) 

(4.35a) 

An alternative way of writing Eq. (4.35a), that is convenient for exhibiting the BRST in- 
variance, is to introduce an auxiliary self- adjoint matrix field h and to reexpress Eq. (4.35a) 



as 



dfidhduduQ [Ae] exp 



(4.356) 
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Starting from Eq. (4.35b), we can now show that Z G has a BRST invariance of the 
familiar form. Let 9 be an ^-independent c-number Grassmann parameter (i.e., a 1 x 1 
Grassmann matrix), and consider the variations defined by 

5oj =cu 2 9 , 

5A e =D t ujQ , 

(4.36) 

SuJ = — ih6 , 
5h =0 . 

We begin by showing that Eq. (4.36) defines a nilpotent transformation, in the sense that 
the second variations of all quantities are zero. To verify this, we show that the variations 
of uj 2 and D(Uj are zero (the variations of h and of are trivially 0), as follows: 
5cu 2 ={5uj,uj} = {u 2 9,lu} = lu 2 {lu,9} = , 

(4.37a) 

5D e u =[8 At, + D t 6w = [D e u9, uj] + D e u 2 9 = —{D f uj, lo}9 + {D e uj, u}9 = . 
To see that Zq is invariant, we note that the action on Ag of the BRST transformation of 
Eq. (4.36) is just a gauge transformation (albeit with a Grassmann valued parameter), and 
so the factors d/i and G[A(\ are invariant. The measure dh is trivially invariant, and the 
measure du is invariant because SuJ has no dependence on UJ. Using 

5(duj) = d(6u) = d(uj 2 9) = (udco + duou)9 , (4.376) 

we have 

(S(du)) mn = (u mm duj mn + du mn uj nn )9 + ... = du mn (uj nn — to mrn )9 + (4.37c) 

with the ellipsis denoting terms that contain matrix elements duj m i n i with (m',n') ^ 
(m,n). Consequently the Jacobian of transformation for du differs from unity by a term 
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proportional to 

^2(uj nn - uj mm )9 = , (4.37d) 

nm 

and so the measure du is also invariant. To complete the demonstration that Z G is BRST 
invariant, we have to show that the gauge fixing part of the Hamiltonian, 

H G = f d 3 xTr(^h 2 +ihJ2 L£A i-^J2 L£Di ^ ' ( 438a ) 

is BRST invariant. Since we have already seen that D^uj is invariant, and since h is trivially 
invariant, we have only to verify that 

= / d 3 xTr[ihJ2 L£6A e ~ {5u)^L l D t u\ = f d 3 xTrihJ2L e D £ {u,9} , (4.386) 

which checks, completing the demonstration of BRST invariance of the generalized partition 
function. 

4E. Reduction of the Hilbert Space Modulo i eS 
Our aim in this section is to further study the structure of averages of dynamical variables 
over the canonical ensemble, and more specifically, to study the implications of the fact that 
the canonical ensemble only partially breaks the originally assumed global unitary invariance 
group. We have seen in Sec. 4B that the canonical ensemble introduces an effective imaginary 
unit operator i c s through 

(C)av = *eff£>eff , (4.39a) 

where D ef[ is assumed to be a real constant times the unit operator, and that the ensemble 
parameter A is functionally related to (C')av using only c- number coefficients. This means 
that the traceless, anti-self-adjoint parameter A must have the form 

A = \i cS , (4.396) 
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with A a real c- number. Therefore if U c g is a unitary matrix that commutes with i e s, 

Ul s U eS = U eS Ul s = 1 , [U cS , ieff] = , (4.39c) 

then U e fi also commutes with A, 

[U eS ,\] = 0=>U eS \Ut s = \ . (4.39d) 

As a consequence, the canonical ensemble partially respects the assumed global unitary 
invariance of the dynamics: the integration measure dfi, the trace Hamiltonian H, and the 
trace quantity N are all invariant under general global unitary transformations of the matrix 
dynamical variables (cf. Eq. (2.7b) and the discussion of Sec. 4A), but as we shall see in 
detail, the term in the exponent in the canonical ensemble TrAC' is invariant only under the 
subset U e fi of global unitary transformations that commute with i ef£ . This has important 
consequences that we shall explore in this section. We shall develop a formalism for isolating 
the effects of the residual global unitary invariance, and after establishing that it is necessary 
to break this invariance in order to extract the full implications of the canonical ensemble, we 
shall give an explicit method for breaking the residual invariance by modifying the operator 
phase space measure. 

Introducing the standard 2x2 Pauli matrices ti,T2,t 3 , it is convenient to rewrite 
Eq. (4.11c) in the form 

i cS = ir 3 l K , (4.40) 

with Ik a K x K unit matrix, where we recall that we have taken the dimension of the 
underlying matrix Hilbert space to be N = 2K. Letting tq = I2 denote the 2x2 unit matrix 
corresponding to the Pauli matrices 71,2,3, a general N x N matrix M can be decomposed in 
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the form 

M =^{t + t 3 )M + + ^{t -t 3 )M_ + t 1 M 1 + t 2 M 2 , (4.41a) 

with M + _ jlj2 four K x K matrices that commute with all of the Pauli matrices Ti )2i3 . Thus, 
corresponding to M — i c g, we would have M + = — M_ = ilx , Mi j2 = 0. For general M, 
let us define M cff and M i2 by 

M efr =i(M - ieffMi eff ) = -(r + r 3 )M + + i(r - r 3 )M_ , 

Mi 2 =M-M cff = riMi + r 2 M 2 , 
so that M eff and M 12 give, respectively, the parts of M that commute and anti-commute 

with i eS , 

i e &M eS =M eS i eS , 

(4.41c) 

i cS M 12 = - M 12 i cS . 
Combining Eqs. (4.41b,c), we get the useful relation 

2t eS M cS = {* eff ,M} . {A Aid) 

We see that for the subset of matrix operators M eS that commute with i eS , the original N 
dimensional Hilbert space diagonalizes into two subspaces of dimension K, on the first of 
which i c ff acts as Hk and M e s acts as M+, and on the second of which i c s acts as —Hr and 
M e s acts as M_. 

Using this notation, let us examine the unitary transformation behavior of the term 
TrAC* in the partition function. Substituting Eq. (4.39b), we have 

TrXC = XTri cS C . (4.42a) 

Under a general unitary transformation of the dynamical variables, we have 

q r -> U ] q r U , p r -> C/^C/ , (7 -> C/^C/ , (4.426) 
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and so the right hand side of Eq. (4.42a) becomes 

\TrUi eS tfC , (4.42c) 

which in general differs from Eq. (4.42a) because a general U does not commute with i e &. 
Thus the TrA(7 term in the canonical ensemble breaks the global unitary invariance of the 
underlying dynamics. However, when U in Eq. (4.42b) is restricted to have the structure U eS 
that commutes with i c g, the transformation of Eq. (4.42b) is still an invariance of Eq. (4.42a), 
and hence is an invariance of the canonical ensemble. 

In group theoretic terms [8], the original U(N) global unitary invariance of H is broken, 
by the term TrAC* in the canonical ensemble, to U(K) x U(K) x R, with R the discrete 
reflection symmetry that interchanges the eigenvalues ±i of i e &. This is clearly the largest 
symmetry group of the ensemble for which one can have {C)av 7^ 0. If one were to attempt 
to preserve the full U(N) symmetry by taking an ensemble with A = iX, with A a c-number, 
then in the canonical ensemble the term TrAC* would vanish by virtue of the tracelessness 
of C, and the resulting ensemble would have (C)av — 0. Requiring the largest possible 
nontrivial symmetry group plays the role in our derivation of making the emergent Planck 
constant a c-number; if on the other hand, we were to sacrifice all of the U(N) symmetry 
by allowing a generic A, then the emergent canonical commutation relations derived in Sec. 
5C below would generically yield a matrix h acting non-trivially on the states of Hilbert 
space, which would be inconsistent with an emergent Heisenberg dynamics. It would clearly 
be desirable to have a deeper justification from first principles of our choice of canonical 
ensemble, perhaps based on a more detailed understanding of the underlying trace dynamics, 
but at present we must simply introduce it as a postulate. 

The residual unitary invariance of the canonical ensemble has the following consequence. 
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Let us write the integration measure dp as 

dp = d[U c ff]d£i , (4.43a) 

with d[£/ e ff] the Haar measure for integration over the subgroup of global unitary transfor- 
mations U e s that commute with i e fr, and with dp, the integration measure over the operator 
phase space subject to the restriction that an overall global unitary transformation U c s is 
kept fixed. Let us consider the canonical ensemble average of a polynomial operator R eS , that 
is a function (with c-number coefficients) of i e g and of the underlying dynamical variables 
q r ,p r and that commutes with i e g, 

7? -IP \ - I d [UcsWpRoS fa o M 
-KcffAV = \-Kcff/AV — — r j\tt u» i • (4.4,50) 

J d[(7 cfr Ja>pi 

We can relate the general operator variables q r ,p r to operator variables q r ,p r that have an 
overall U c g rotation frozen, by writing 

q r = Ul s q r U cS , p r = Ul s p r U cS , (4.43c) 
and so correspondingly we have 

R cS = U\ s R cS U cS , (4.43d) 

with R c s obtained from R e g by the replacements q r , p r — > q r ,p r - Since the canonical ensemble 
is invariant under unitary transformations that commute with i e s, we have p — p, with p 
constructed in the same manner as p, but using the variables q r ,p r in place of q r ,p r - Putting 
all these ingredients together, we can rewrite Eq. (4.43b) in the form 

RcSAV ~ — JW^i — ' (4 - 44o) 
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with i? cfrA v given by 

Writing all matrix quantities in terms of + and — components according to Eq. (4.41b), 
Eqs. (4.44a,b) separate into the independent ± components 

f dp^p^R^ jw ± U eS ± i a a a \ 

^ AV± = ' ( c) 



with R eSJ c w ± given by 



_ / dfipR eS ± 
jdfipl 



iW = ^^ ■ (44*0 



In both the ± cases, the integral on the right hand side of Eq. (4.44c) has the general 
form 

with Mk a K x K matrix and with Uk a K x K unitary matrix. But replacing Mk by 
V^-MkVk, with Vk unitary, and using the invariance property d^xUx] = d[Ux] of the 
Haar measure, we see that I[M K ] = I[V^-M k Vk] for arbitrary unitary Vk- Thus I[M K \ 
is a linear, unitary invariant function of M K , which on the unit matrix takes the value 
I [Ik] = Ik- These properties imply that I[M K \ is given by the trace 

I[M k } = ^1 k Tt k M k . (4.456) 

We learn from this that if we take an unrestricted average of i? e fr over the canonical ensemble, 
the interesting matrix operator structure is averaged out. To preserve this structure, we 
must restrict the integration in the canonical ensemble to leave an overall global unitary 
transformation U e s fixed, as in R cS A y of Eq. (4.44b). 
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Let us now give an explicit recipe for fixing an overall global unitary transformation that 
commutes with i e &. We begin by assuming that the structure of the trace Hamiltonian is 
such that we cannot split the dynamical variables {x r } into two disjoint sets {x^} and {x^ 1 }, 
such that the trace Hamiltonian exactly separates into disjoint pieces, 

H = H'[K'}] + H"[{^}] . (4.46) 

If Eq. (4.46) were to hold, the fact that C and N are additive over the dynamical degrees 
of freedom would then imply exact factorization of the partition function Z according to 
Z = Z 1 Z n , and we would then have to address the same problem of fixing a global unitary 
invariance at the level of both Z 1 and Z 11 . Put another way, we begin by assuming that our 
trace dynamics is irreducible, in the sense that it cannot be exactly reduced to two or more 
independent trace dynamics systems. 

Once this assumption has been made, it suffices to fix a global unitary rotation of any 
one dynamical variable xr, which we shall assume to be a self-adjoint bosonic variable, and 
which we denote for further discussion by M. Let dfj,(M) be the factor contributed by M to 
the integration measure d\i of Eq. (4.2b), that is 

dv(M)= J] dMi n , (4.47a) 

m<n,A 

with self-adjointness implying that the diagonal imaginary parts M^ m are zero (cf. Eq. 
(4.6b)). Making the Pauli matrix decomposition of M given in Eq. (4.41a), with self- 
adjointness of M implying that M +) _ 5 i i2 are all self-adjoint K x K matrices, we have 

dfi(M) = constant x dfi(M + )d/2(M_)dfi(M 1 )dfi(M 2 ) , (4.476) 

with the overall constant not relevant for computing averages over the canonical ensemble 
since it cancels out between numerator and normalizing denominator in (O) (cf. Eq. (4.10a)). 
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In order to fix an overall unitary rotation U e g, it suffices to fix independent overall unitary- 
rotations in the submatrices M +i __ that determine M e g. This can be done explicitly by 

writing M +i _ as unitary rotations from diagonal matrices -D+,-, 

M + =Ul s+ D + U eS+ , 

(4.48a) 

and then using the formula [21] 

dn(M±) = constant x d[U eS ±] A(A±) 2 JJ d\ ±i . (4.486) 

i 

Here A±j are the real eigenvalues of M±, A(A±) is the Vandermonde determinant 

A(A) = n(Ai - A,-) , (4.48c) 

and d[C/eff±] are the Haar measures for the unitary groups generated by U e g±. Simply omitting 
the integrations over these unitary groups then gives the necessary freezing of the global 
unitary invariance U e g. In other words, the restricted measure dp, is explicitly defined by 
replacing Eq. (4.48b) by 

djl(M±) = constant x A(A±) 2 JJ d\ ±i , (4.48d) 

i 

for the one chosen self-adjoint variable M. 

In field theory applications, the index r for degrees of freedom will contain the specifica- 
tion of a spatial point x, and the unitary invariance fixing discussed above is implemented 
by taking M to be a bosonic variable at a specific spatial point X, on the specified time slice 
t = T used in the canonical ensemble. As a result of this global unitary fixing, if we form 
the average -R effA v °f a polynomial function of i c s and of operators at various space-time 
coordinates x", and then shift all space time coordinates by a common amount a u , the re- 
sulting average will be changed, even when the dynamics is space-time translation invariant, 
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because the variable that is frozen is changed from M(x, T) to M(x + a,T + a°). (Even when 
a = and there is only a time translation a°, dynamical evolution of the system results in 
M(x,T + a ) differing from M(x,T), and so the global unitary fixings based on them will 
differ.) In a theory with space-time translation invariant dynamics, the shifted result will be 
related to the unshifted one by a global unitary transformation that commutes with i eff , 

i?K) effA v = tfK)!fffl(o)*Avtf(«5f) » ( 4 - 49 «) 

since this is the general structure of the transformation that relates two inequivalent global 
unitary invariance fixings. When substituted into Eq. (4.44a), the transformation U(a u ) e s 
can be absorbed into the integration measure, leading to the expected result that the un- 
fixed average is space-time translation invariant. (Formally, this invariance results from the 
facts that space-time translations are a canonical transformation generated by the trace 
four- momentum P u , and that this canonical transformation is an invariance of the unfixed 
integration measure d/i. Hence the effect of an overall space-time translation can simply be 
absorbed into the integration measure in the unfixed case.) Because the shifts by a u form 
an Abelian group, invoking Stone's theorem tells us that U(a u ) cS must have the generator 
form 

U(a v U = exp(i eS fi- 1 a v P^) , (4.496) 

with ft -1 P e g a self-adjoint matrix that commutes with i e s (and with a v = r\ iiv a v , where 
Vn" = (1? 1, 1 ; — 1) is the Minkowski metric and we have used the usual relativistic summation 
convention.) Equations (4.49a,b) thus have the same structure as the space time translation 
properties of a polynomial function of field operators in quantum field theory, giving a hint 
already that under certain conditions a quantum field theory structure can emerge from the 
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statistical mechanics of trace dynamics with a global unitary invariance. Developing this 
idea further is the subject to which we turn in the next section. 
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5. Ward Identities and the Emergence of Quantum Field Dynamics 

In Sec. 2, we have seen that a generic feature of matrix models with a global unitary 
invariance is the existence of a conserved operator C, 

C = ^2[q r ,Pr] - ^{<?r,Pr} = ^X r U ru X u , (5.1) 
r,B r,F r,u 

which is anti-self-adjoint when we adopt the fermion adjointness assignment of Eqs. (2.4b) 
and (2.18d). The operator C, which is given by the sum of bosonic q r ,p r commutators minus 
the corresponding sum of fermionic anticommutators, together with the trace quantities H 
and N, plays a role in the equilibrium statistical mechanics of trace dynamics closely analo- 
gous to that played by the energy in classical statistical physics. This analogy suggests the 
idea [7] that the canonical commutation relations of quantum field theory may arise from 
a trace dynamics analog of the classical theorem of equipartition of energy. To pursue this 
thought, let us begin by reviewing a simple derivation [22] of the classical equipartition theo- 
rem. Let H({x r }) be the classical Hamiltonian as a function of classical phase space variables 
{x r }, and let dfi{{x r }) be the classical phase space integration measure. We consider the 
integral 

d[x r exp(— (3H)\ 

dfX dx~ s 

dfi5 rs exp(—j3H) (5.2a) 

-J dfix r d ^^ exp(-/3ff) , 

the left hand side of which is the integral of a total derivative and vanishes when the integrand 
is sufficiently rapidly vanishing at infinity. Assuming this, we get 

_ / dfix r p(dH/dx s )exp(-pH) 
6rs ~ fdnexpi-PH) ' { ' 

78 



/' 



which is the classical theorem of equipartition of energy. The method of derivation is similar 
to that used to derive Ward identities from functional integrals in quantum field theory (see, 
e.g. [23]), and the equipartition theorem can be viewed as a Ward identity application in 
classical statistical mechanics. 

5A. The General Ward Identity 

We now apply a similar procedure to the statistical mechanics of matrix models. We 
begin by specifying some notation. Let dp be the measure introduced in Eqs. (4.43a) and 
(4.48d), in which the integration over one dynamical variable xr is restricted so as to break 
the subgroup of the global unitary group that commutes with i cS . Also, let (C?) A y be the 
average over the canonical ensemble, using this restricted measure, of a general operator 
depending on the {x r }. This average is formed as in Eq. (4.10a), 

with p and the partition function Z given by Eq. (4.13c), as modified by the replacement 
of dp, by the restricted integration measure dp,. Since we shall wish to include sources, let 
(O) fa j be the corresponding average in the presence of a complete set {j r } of external 
sources, given by 

iou,,^ , out) 

with p and Z given by the expressions (cf. Eq. (4.15a)) that include sources, now with 

restricted integration measure, 

p =Z~ X exp(— TrAC* — tH — r/N — Trj r ^r) , 

f r (5.3c) 

Z — I dpexp(—Tr\C — tH — r^N — Trj r x r ) . 

J r 
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Thus, in this notation, we have 

<0> AV = < >av,o , (5.3d) 

with the subscript on the right hand side denoting the average in which all sources are zero, 
that is, with {j r } = {0}. In the deriving the Ward identity, we shall employ the fact that 
the integration measure d\i is invariant under a constant shift x r — > x r + 5x r of any of the 
dynamical variables x r . When we use the restricted integration measure dp, this invariance 
still holds, provided r is not equal to the index R of the one variable xr for which the phase 
space integration is restricted. In other words, with respect to the restricted measure we 
have 

= J dp5 Xr (pO) , r^R , (5.4a) 

with 

S Xr A = A\ Xr+Sxr -A\ Xr • (5.46) 
With this notation established, we begin our derivation by considering 
Z(Tr{C,i cS }W)^ = f dpexp(-Tr\C -rK-r]N -^Trj r x r )Tr{C,i eS }W , (5.5a) 

J r 

with W any bosonic polynomial function of the dynamical variables, and where the trace Tr 
is understood to act on the product of all factors standing to its right. Using Eqs. (5.4a,b), 
when we make a shift of x s , s ^ R in the integrand of Eq. (5.5a), we have 

= / dp5 Xs [exp(— TrA(7 - rH - r]N - Trj r x r )Tr{C, i cS }W] , (5.56) 

J r 

which on applying the chain rule for differentiation becomes 

= dp exp(-TrAC' - rH - - V Trj r x r ) 

J r (5.5c) 

x [(—Tr X5 Xs C - t5 Xs H - V 5 Xs N - Tr j s 8x s )Tr{C ,i eS }W + 8 Xs Tr{C ,i eS }W] . 

80 



We now have to evaluate the variations with respect to x s appearing in the various terms 
on the right hand side of Eq. (5.5c). From Eq. (2.6) for C, we have 

TrX5 Xs C = TrA ^^(5x s co sr x r + x r co rs 5x s ) , (5.6a) 

r 

which by Eq. (1.17) can be rewritten as 

TrX5 Xs C — Tr\^^u! rs (—e r 5x s x r + x r 5x s ) , (5.66) 

r 

and by Eqs. (l.la,b) simplifies to 

Tr X8 Xs C — Tr[A, 'y^u rs x r ]5x s . (5.6c) 

r 

We next consider 5 Xs ll, which by Eqs. (1.3b) and (1.15b) through (1.17) is given by 

S Xa ll = Tr- — 5x s = > uj rs Trx r 5x s . (5.7) 



Sx s 

r 



Turning next to the evaluation of 5 Xs N, let us define u rs by 

u) rs = diag(0, ...,0,fi B , ...,fi B ) , (5.8a) 

where the 2x2 matrix f2 B is defined in Eq. (1.16b). Recalling our convention that we list 
all bosonic variables before all fermionic ones in the 2_D-dimensional phase space vector x r , 
the definition of Eq. (5.8a) states that Cj rs acts as on any bosonic phase space pair q r ,p r 
and acts as Qb on any fermionic phase space pair q r ,p r , so that 

^2u ru x r x u = ^2[q r ,p r } , (5.86) 

r,u r,F 

giving the quantity appearing in Eq. (2.2a) defining N. We then find 

5 Xa N = —i Tr(6j sr 5x s x r + cu rs x r 5x s ) = i u rs Tr x r 5x s . (5.8c) 



2 

r 
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This completes the calculation of variations of terms that come from the exponent in the 
canonical ensemble p. 

The remaining terms come from 

S Xs Tr{C,i ef{ }W = Tr ({6 Xs C,i eS }W + {C,i eS }6 Xs W) . (5.9a) 

For the first term on the right hand side of Eq. (5.9a), we use Eq. (5.6c), with A replaced by 
{i e s, W} = 2i e ffW e s (where we have simplified using Eq. (4.41d)), giving 

Tt{5 Xs C, i cS }W = Tr{* eff , W}6 X ,C = Tr[2t cS W c{i , ^ u ra x r ]Sx 9 . (5.96) 

r 

To evaluate the second term on the right hand side of Eq. (5.9a), we write the operator 
structure of W in the form 

W = J2 W s Lix sW s m , (5.10a) 

i 

where t indexes each occurrence of x s in W, so that in this notation we have 

^L^etWfW? , (5.106) 

with e£ the grading factor appropriate to Wf 1 and to W^ e x s (which must both be of the 
same grade since we have defined W to be bosonic). With this definition, we find 

Sx.W = J2 W s U ^sW s m , (5.10c) 

i 

giving finally 

Tr{C,i eS }5 Xs W = Y. e <^ W ™ {C,ies}W s u 8x s . (5.10a 1 ) 

i 

When these results are collected and substituted back into Eq. (5.5c), this equation takes 
the form (after multiplication by Z^ 1 ) 

= (TrE s fe s ) AVj , (5.11a) 
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with S s a shorthand for the sum of the contributions coming from Eqs. (5.6a) through 
(5.10d), 

S s =(-[A, ^ U rs Xr\ - T ^ LO rs X r - 17] ^ UJ rs X r - 2Tr(7iefT W eff 

r ^ ^ r (5.116) 

+2[i e{i W e{i , UrsXr] + ^"{C, *cft}W^ . 

r £ 

Since the variation 5x s is arbitrary, subject to the adjointness restrictions on x s , and since 
both the real and imaginary parts of Eq. (5.11a) must vanish separately, we can conclude 
from Eq. (5.11a) that 

(E.) aVj - = • (5.11c) 

To get the final form of the Ward identity, we perform several algebraic manipulations 
on Eq. (5.11c). First of all, we form the effective projection by taking one half of the 
anticommutator of Eq. (5.11c) with i eS (cf. Eq.(4.41d)). Since A = \i c f[ (cf. Eq. (4.39b)), 
and since i c s commutes with x re s, the first term on the right hand side of Eq. (5.11b) drops 
out and we are left with 

(E seff ) AV; . = , (5.12a) 

with E seff given by 

S sc ff =(-t ^2 ^rsXrcS ~ iy ^ Cu rs x rcS - j scS ) 2TrCi eS W ef[ 

r ^ ' ^ (5-126) 

+2[t cS W cS , "rsXres] + ^ t t {W™ {C , i eS }W s U ) eS . 
r I 

(This step of the derivation requires use of the canonical ensemble: in the micro canonical 
ensemble, the analogous term arising from the C dependence of the ensemble V does not have 
the form of a commutator [A, ...], and so does not vanish on taking the effective projection.) 
Next, we multiply Eqs. (5.12a,b) by \uo us and sum on s, evaluating the sums using 
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Eq. (1.17), which gives 

^us^rs — $ur , (5.13a) 

s 

together with the the formula 

s ^^LU us Cu rs x r = — , (5.136) 

rs 

with £ u = for any bosonic x u and with £ u = 1(— 1) for x u a fermionic q(p). This gives the 
final result 

(A«cfr) A v J = > ( 5 - 14a ) 

with A ucff given by 

s 

=(-rx ueS + ir]^ u x ucS - ^2 u U sisc$)^Ci cS W cS ^ 

s 

+ [i cS W eS ,x ue{i ] +J2"usee [W s m ^{C,i eS }W s u 



s,e x 
5B. Variation of the Source Terms 

The Ward identity of Eqs. (5.14a,b) is exact, and still includes the full source term 
structure. Our next step is to show how, through variation of the source terms, we can 
generate similar Ward identities involving general polynomials in the effective projections 
x re f{ of the dynamical variables. To see how such polynomials can be generated, we recall that 
in the notation introduced in Eq. (4.41b), when the source term in the canonical ensemble 
is rewritten using the decompositions x r = x re s + x r u and j r = j re s + j r i 2 , we get Trj r x r = 
Tr(j re fr^rcfr+jri2^ri2), and so varying with respect to j re s brings down a factor of TrojVeff^Veff ■ 
Stripping away the general variation <5j rc fr from the left then leaves us with a matrix factor 
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x re ff. As we shall see, doing this repeatedly allows one to build up general polynomials. We 

can now state the result to be demonstrated in this section as follows: defining Vx uc s by 
Vx^s =(-rx uefi + ir]£ u x ucS )Tr Ci cfi W cS 

+[i eS W eS ,x ueS } + Y^Uu S ee (w s m ^{C,i eS }W* 
we can rewrite Eq. (5.14a) as 

(Vx ucS - ^ (j us j seS TrCi ef£ W e s) aVj = . (5.156) 

s 

Then we shall show that Eq. (5.15b) also implies the relations at zero sources, 

(SL(xtett)('DS(x re fi))S R (x te s))j£ /fi = > (5.15c) 

with S a general polynomial (with c-number coefficients) in the effective variables x re s on 
which V acts by the Leibnitz product rule 

V(x reS x se s) = (Vx reS )x se fi + x re s(Vx sef i) , (5.15d) 

and with Sl and Sr polynomials (also with c-number coefficients) with the property that 
for all x t in Sl^r and all x r in S, the structure constant u tr is zero. An equivalent way of 
stating the result of Eq. (5.15c) is obtained by noting that for a V that acts by the Leibnitz 
rule, we have 

VS(x reS ) = y~]S(x re K, r ^ u; Vx ueS ) , (5.16a) 

u 

with all factor orderings left undisturbed when V acts on monomials in x re fj. Since the case 
of a polynomial S with c-number coefficients can be obtained by linearity from the case of a 
monomial S, to establish Eq. (5.15c) it suffices to prove that for monomials S, S L , and S R , 
we have 

(S L (x t es) y^avaff r ^ u;Vx ucS )S R {x tc ft))pi Wfl = . (5.166) 

u 
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(5.15a) 



To prove this assertion, we begin by multiplying Eq. (5.15b) by ZSj ue s and taking the 
trace, giving 

ZjTrSjueffVxues - ^ uj us Tr(5j ueS j seS )TrC%, ff W eS ) aV ■ = . (5.17a) 

s 

We now make sequential, independent variations of the sources j re s associated with all x re s 
in the monomial S other than the one x uc g that is explicitly exhibited in Eq. (5.17a), as 
well as variations of the sources associated with all x te s in the monomials Sl,r- To get 
repeated factors of some particular xr e s, we make independent source variations for each, 
and after all variations have been performed, we set all sources equal to zero. In the second 
term in Eq. (5.17a), if j se s is not varied in this process, it makes a vanishing contribution 
after the sources are set to zero. The case when j scS is varied can only arise when we are 
varying with respect to the source for a variable x vcS contained in S, since by hypothesis the 
coefficient tensor uj ut vanishes for all x te a in Sl,r- In general, if we focus on two variables 
x ve s and x ue s for which oj uv ^ 0, the polynomial S will have the form ...x ue g....x ve {i.... (or a 
similar expression with the roles of u and v interchanged; we do not assume symmetrization 
of this structure over u and v), with ... denoting factors that are not explicitly exhibited. 
Correspondingly, the derivative T>S formed by use of the Leibnitz rule will have the form 

...(Vx ucfi )...x vcS ... + ...x ucS ...(Vx vcS )... . (5.176) 

In forming the first term in Eq. (5.17b) by source variations, the second term of Eq. (5.17a) 
will contribute the second variation expression 

...u uv Tr(5j ucS j vcS )... , (5.17c) 

while in forming the second term in Eq. (5.17b), there will be a corresponding second vari- 
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ation expression 

...uj vu Tr(Sj veS j ue{i )... . (5.17d) 

Since both second variation expressions multiply identical factors, they contribute through 
their sum 

■ ■■[uJ uv Tr(5j ucS j vcS ) + uj vu Tr(5j veS j ucS )]... . (5.17e) 

However, this expression vanishes, because in the bosonic (fermionic) case u uv is antisym- 
metric (symmetric) in u, v while the trace multiplying it is symmetric (antisymmetric) in 
u, v. 

Thus, in forming Eq. (5.16b) by source variation, the explicit source term in Eq. (5.15b) 
does not contribute after all sources are set equal to zero, and so the effect of multiple source 
variations is to lead to an expression of the form 

Z(Y[ Tr(5j r efr^reff)Tr(5j U eff^ U eff) ) A V,o • (5-17/) 

Since the sources variations in Eq. (5.17f) are all independent, we can use them to "break 
open" the traces as in the discussion of Eqs. (1.4a-d), giving the expression 

( J_ J_ ( x rcS )n r m r {J^ x ucS )n u m u ) AV,0 ' 

(5.17<?) 

with the average now involving a product of matrix elements. By linking the matrix elements 
in Eq. (5.17g) in the appropriate order, we can form the general matrix element of T> acting 
on a general monomial S, multiplied on the left and right by monomials S^r containing 
variables x te & that are not linked by uj rt to any variable x re R in S. This then gives the 
identity of Eq. (5.16b), completing the proof of Eq. (5.15c). 
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5C. Approximations/ Assumptions Leading to the Emergence 

of Quantum Theory 

Starting from Eqs. (5.15a-c), we proceed now to show that with a few plausible as- 
sumptions and approximations, the general formalism of quantum field theory emerges. The 
assumptions and approximations that we make all have the effect of simplifying the structure 
of Vx uc f[. They are: 

(1) We assume that the support properties of x uc q and of C e & = —^i e s{i e s, C*} in the operator 
phase space are such that the term 

-Tx ucS TiCi c{i W cS 

(5.18a) 

= - Tx ueS TrC eS i ef iW e s 
in Eq. (5.15a) can be neglected. Specifically, we shall assume that this comes about in 

the following way. We identify the time scale r and mass r _1 with the "fast" or "high" 

physical scale given by the Planck scale, and we assume that the underlying theory 

develops a mass hierarchy, so that observed physics corresponds to "slow" components 

of x uc f{ that are very slowly varying in comparison to the time r. We also assume that 

the "fast" components of x ue s have disjoint support from the support of C e &. Then for 

the "slow" components of x ue fi, the contribution to Eq. (5.18a) will be small because 

it is suppressed by one power of the mass hierarchy, while for the "fast" components 

of x ue s, the contribution to Eq. (5.18a) will be small by virtue of the assumed support 

properties. A more detailed discussion of this assumption and its implications will be 

given in the next section. (This assumption could perhaps be weakened to allow for 

the possibility that the "fast" components of x uc s have regions of common support with 

C c s, but that rapid relative phase oscillations make the contribution of Eq. (5.18a) to 
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the Ward identities very small. However, we shall not pursue this possibility further in 
what follows.) 

(2) We assume that the "chemical potential" rj is very small, so that the term 

iri£ u x ucS TrCi cS W cS (5.186) 

can be neglected. Since this term is identically zero for u bosonic (cf. the line following 
Eq. (5.13b)), this assumption is only operative in the fermionic sector of the theory. 

(3) We assume that in the final term of Eq. (5. 15a) , we can replace the conserved quantity C c s 
by its zero source ensemble average (Ceff ) A y = (C'eff)Av — ieS^- In other words, we assume 
that in this term, fluctuations in C c s over the canonical ensemble are unimportant. (As 
discussed in the next section, the corresponding replacement cannot be made in the r 
term in Eq. (5.15a), since it would change the support properties in a significant way.) 
With this assumption, the final term of Eq. (5.15a) becomes 



-hJ2"u S ei(W s m W s L % s = -hJ2"us (^-) , (5.18c) 



where in simplifying we have made use of Eq. (5.10b). 

With these assumptions, Eq. (5.15a) simplifies dramatically to take the form 

Vx ueG = i cS [W cS , x ucS } - h } u us ( - — , (5.19a) 

s V dX s J eflf 

where we have used the fact that i c s commutes with all effective quantities to pull it outside 
the commutator in the first term. We can now use this simplified form of V in the Ward 
identity with sources given in Eq. (5.15b), and in the Ward identity obtained after source 
variations given in Eq. (5.15c). As discussed in [7], specialization of the operator polynomial 
W gives a number of important results. 
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(A) First, let us take W in Eq. (5.19a) to be the operator Hamiltonian H = J2 r Pr4r — L, 
with H = TrH the corresponding trace Hamiltonian, as in Eq. (1.9b). Then by using the 
trace dynamics equation of motion of Eq. (1.15b), Eq. (5.19a) simplifies to 

Vx ucS = i cS [H cS ,x uc f[] - hx ueS . (5.196) 

Using Eq. (5.19b) in Eq. (5.15c), we learn that x ue s obeys an effective Heisenberg picture 
equation of motion, which holds when sandwiched between polynomials S^r that do not 
contain x u and averaged over the zero source canonical ensemble. If we now take S in 
Eq. (5.15c) as the Hamiltonian H cS , and substitute V from Eq. (5.19b) and use the chain 
rule, we learn that 

(Sl {Xteff ) H eS S R (x tc s ) ) av,0 

(5.19c) 

= (Sl (^tefr)^cfr^ 1 [H c g, H e fi]SR(x te fi))jw fi = , 
showing that within our approximations H e s behaves as a constant of the motion, as required 
for consistency of the interpretation of Eqs. (5.15c) and (5.19b) as an effective Heisenberg 
dynamics. 

Integrating now with respect to time, we learn from Eq. (5.19b) that 

x ue s(t) = exp(i cfr ^,~ 1 i7 cfr t)a; ucff (0) exp(-i cff ^~ 1 i7 eff t) , (5.19d) 

when sandwiched between polynomials S^r that do not contain x u , and averaged over the 
zero source ensemble. If we consider the ensemble average of an arbitrary polynomial S 
formed from dynamical variables, taken at different times, and advance them all in time by 
the same time increment a , we correspondingly get 

(S\At=a°)Av,o = (exp(? cfr /i _1 i7 cfr a )S'|At=oexp(-? cfr ^ 1 i7 cfr a )) AVj0 . (5.20a) 
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Since H e g is a constant of motion, we expect it to be approximately constant over the peak 
of the canonical ensemble. Making the approximation of taking the exponentials in if e fr 
outside the ensemble average, Eq. (5.20a) becomes 



When we make the identification P c ° ff = H eS , this equation agrees with the exact relations 
of Eqs. (4.49a,b), which were obtained from general considerations of fixing a global unitary 
transformation U c g in the integration defining the canonical ensemble. 

(B) Next, let us take W in Eq. (5.19a) to be a t x t , with a t an auxiliary c-number parameter 
which is a real or complex number for t bosonic, and is a real or complex Grassmann number 
for t fermionic, so that W in both cases is bosonic. We then have SW/5x s = a t 8 st , and 
Eq. (5.19a) becomes (after multiplication through by i e s) 



Equation (5.15c) then tells us that this expression vanishes when sandwiched between gen- 
eral polynomials Sl,r (which do not contain x u ) inside the zero source canonical ensemble. 
Translating from the compact symplectic notation used in Eq. (5.21a) by recalling the defi- 
nition of uj u t given in Eqs. (1.16a,b), and factoring away the parameter a t with attention to 
the fact that it is Grassmann for fermionic t, we learn from Eqs. (5.15c) and (5.21a) that 
within ensemble averages, we have the effective canonical commutators 



(S\ A t=ao)A Yfi = exp(i cS h 1 i?cfra°)(S'|At=o)Av,o ex P(^cfr^ 1 H cS a°) 



(5.206) 



i cf[ Vx ucS = [x uc ff,a t x tcS ] —i cfl huj ut a t 



(5.21a) 



[?iteff, Qtcs] — [PucS,Ptcs] — , [q U eft,Ptes] ~ «eff^ 



'ut 



(5.216) 



for u, t bosonic, and the effective canonical anticommutators 



{lueS, Qtes} — {Pue&,Ptes} ~ , { q ue S , PteS } ~ ieS^ut 



(5.21c) 
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for u, t fermionic, with the corresponding commutators of bosonic with fermionic quantities 
all vanishing. (In other words, the entire canonical algebra for boson and fermion degrees 
of freedom is compactly encoded in the statement that the right hand side of Eq. (5.21a) 
vanishes.) Thus, as suggested at the beginning of this section, the Ward identities do in 
fact lead to an equipartitioning of C, giving rise in an emergent fashion to the canonical 
commutator/anticommutator structure that is the basis for field quantization. Note that 
the emergence of the canonical algebra implicitly requires a limiting process. As is well 
known, in a complex Hilbert space the canonical algebra [q,p] = i, [q,i] = \p,i] = cannot 
have finite dimensional (or more generally, trace class) representations, since this algebra 
implies, for example, the relation q 2 p 2 + p 2 q 2 — 2qp 2 q = —2, which in a finite dimensional 
Hilbert space would have a left hand side with trace zero and a right hand side with trace 
nonzero. However, it is consistent for the canonical algebra to emerge as the limit N — > oo 
of a matrix algebra in an N dimensional Hilbert space, or as an idealized approximation to a 
matrix algebra in a Hilbert space with N large but finite (or as an approximation to a more 
general trace class algebra). 

(C) Finally, let us take W in Eq. (5.19a) to be a general self-adjoint polynomial G, so that 
G is the generator of general canonical transformations of the trace dynamics as discussed 
in Eqs. (2.13a,b). Then combining Eq. (5.19a) with Eq. (2.13b), and dividing by H, we get 

hT 1 Vx ueS = i^[h~ 1 [G eS ,x ueS \ - 5x ucS , (5.22a) 



which tells us that sandwiched between polynomials Sl,r in the zero source canonical en- 
semble, general infinitesimal canonical transformations are effectively generated by unitary 
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transformations of the form 



£4an cff = exp(i cS h 1 G eS ) 



(5.226) 



In trace dynamics models defined as continuum theories, such as the examples of Sec. 3, 
this result states that the canonical trace Poincare generators are represented at the effective 
level by operator generators. In particular, in Poincare invariant theories the trace three- 

— * 

momentum will have a corresponding operator three momentum P eff that is time independent 
(by similar arguments to those used to show that H cf[ is time independent), and that serves 
to generate translations through a unitary transformation 



To sum up, we have shown that the basic structure of quantum field theory - the canon- 
ical commutator/anticommutator structure, time evolution in the Heisenberg picture, and 
the unitary generation of canonical transformations - emerges from the statistical thermody- 
namics of matrix models with a global unitary invariance. The results that we have obtained 
suggest a direct correspondence between averages of operator polynomials in the zero source 
canonical ensemble and the corresponding operator polynomials in complex quantum field 
theory, 



with the X rcS on the right quantized operators in a quantum theory with the role of i played 
by the matrix i e s, which commutes with all of the X re s. Since i e s diagonalizes into two 
K x K blocks as indicated in Eq. (4.40), the correspondence of Eq. (5.23a) actually gives 
two uncoupled copies of a complex quantum field dynamics, on one of which i e & acts as i 

93 




(5.22c) 



(S({x reS })) Kv & S({X rcS }) 



(5.23a) 



and on the other of which i c g acts as the complex conjugate —i. Let us now focus on the 
copy on which i c g acts as i; similar considerations, apart from sign changes in the fermion 
sector that will be discussed below, apply to the copy on which i e s acts as —i. 
We now make two further structural assumptions: 

(4) In the continuum limit, with the indices r labeling infinitesimal spatial boxes as well as 
internal symmetry structure, the underlying trace Lagrangian L is Poincare invariant. 

(5) The underlying dynamics leads to an H e g that is bounded from below by the magnitude 
of the corresponding effective three-momentum operator P eS , with P^ s the generator 
defined in Eq. (4.49b), and there is a unique eigenvector ip with lowest eigenvalue of 
H e s- 

With these two assumptions we can make contact with quantum field theory. According 
to assumption (5), the eigenvector ipo acts as the conventional vacuum state, and sandwiching 
Eq. (5.23a) between ijr Q and ijj , we get the correspondence between trace dynamics canonical 
ensemble averages and Wightman functions in the emergent quantum field theory, 

^ {S({x reS }))^ <S> (vac| 1 S({X rcfr })|vac) . (5.236) 

(Equation (5.23b) applies in the sector where i e g acts as i; in the sector where i c s acts as 
—i, it is necessary to identify the fermionic ip^ on the left of Eq. (5.23b) with the field op- 
erator — vl/t on the right, in order to obtain consistency with the positivity properties of the 
fermionic field anticommutator. This will be discussed in further detail in Sec. 5E). When 
the underlying trace dynamics is Poincare invariant, the fact that Poincare transformations 
are canonical transformations with global unitary invariant generators implies, by the dis- 
cussion of Sec. 2, that C is a Poincare invariant. Hence the term TrAC in the canonical 
ensemble is a Poincare invariant, and in particular is a Lorentz scalar. Although the term 
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tH in the canonical ensemble is not a Lorentz scalar, in the low energy regime where approx- 
imation (1) is valid, so that variations in the r term can be neglected in the Ward identities, 
the Lorentz non-invariance associated with this term decouples, giving a Lorentz invariant 
effective field theory. Hence with the assumptions and approximations that we have made, 
the correspondence of Eq. (5.23b) defines Wightman functions of a Lorentz invariant effective 
field theory. Although our Ward identity derivations required the exclusion of certain index 
values (the x s that is varied cannot be the xr for which the phase space integral is restricted, 
and the polynomial S in Eq. (5.15c) cannot contain variables x t that appear in Sl,r), in the 
continuum limit with s labeling infinitesimal spatial boxes, these exclusions amount to a set 
of measure zero and have negligible effect. 

Let us briefly enumerate the basic properties of Wightman functions [24] (see Appendix 
F for further details) and indicate why, with the correspondence of Eq. (5.23b), it is plausi- 
ble that they are obeyed, (i) By constructing the Wightman functions from thermodynamic 
averages, they are expected to have the requisite smoothness properties, i.e., they should 
be tempered distributions, (ii) Lorentz covariance of the Wightman functions follows from 
Lorentz invariance of C and our assumption that the noninvariant r terms effectively de- 
couple, (iii) The spectral condition for the Wightman functions follows from the formula 
of Eqs. (4.49a,b) for the effect of a uniform space-time translation, together with the pos- 
itivity and boundedness assumption (5). (iv) Locality of the Wightman functions follows 
from the canonical commutation/anticommutation relations derived, in the approximation 
of neglecting the r terms, in Eqs. (5.21a-c). (v) The hermiticity and positivity properties 
of the Wightman functions follow directly from the correspondence with thermodynamics 
averages of Eq. (5.23b). (vi) The cluster property of the Wightman functions corresponds 
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to the assumptions about H made in the clustering argument used in the discussion of the 
microcanonical ensemble in Eqs. (4.19a-c). 

To conclude this section, we note that there is a natural hierarchy of matrix structures 
leading from the underlying trace dynamics, to the emergent effective complex quantum field 
theory, to the classical limit. In the underlying theory, the matrices x r are of completely 
general structure. No commutation properties of the x r are assumed at the trace dynam- 
ics level, and since all degrees of freedom communicate with one another, the dynamics is 
completely nonlocal. (As a consequence of this nonlocality, the Bell theorem arguments [25] 
against local hidden variables do not apply to trace dynamics.) In the effective quantum 
theory, the x r are still matrices, but with a restricted structure that obeys the canonical 
commutator/anticommutator algebra. Thus, locality is an emergent property of the effec- 
tive theory, even though it is not a property of the underlying trace dynamics. Finally, in the 
limit in which the matrices x r are dominated by their c-number or classical parts defined in 
Eqs. (2.16a,b), the effective quantum field dynamics becomes an effective classical dynamics. 
Thus, both classical mechanics and quantum mechanics are subsumed in the more general 
trace dynamics, as reflected in the following hierarchy of matrix structures, corresponding 
to increasing specialization: general — > canonical quantum — > c-number, classical. The in- 
determinacy characteristic of quantum mechanics appears only at the middle level of this 
hierarchy of matrix structures. At the bottom or trace dynamics level, there is no indeter- 
minacy (at least in principle, given the initial conditions) because no dynamical information 
has been discarded, while at the top or classical level, quantum indeterminacies are masked 
by large system size. 
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5D. Restrictions on the Underlying Theory Implied 
by Further Ward Identities 



In this section we shall take a critical look at the assumptions and approximations made 
in the previous section in the course of our argument for the emergence of quantum behavior. 
We shall do this by deriving further Ward identities, and showing that their consistency with 
the Ward identity derived in Sec. 5A, and with the approximations made in Sec. 5C, places 
nontrivial constraints on the structure of the underlying trace dynamics. 

The first additional Ward identity is obtained by proceeding as we did starting from 
Eq. (5.5a), but with {C,i e s} = 2i eS C e fi in the factor Tr{(7, i e s}W replaced at the outset by 
its ensemble average —2h. Thus, factoring away the constant —2h, we start now from 

Z(TrW0 AV = / djlexp(-Tr\C - rH - ??N - Trj r x r )TrVy , (5.24a) 

J r 

and proceed as we did in Sec. 5A. The derivation completely parallels that leading to 
Eqs. (5.14a,b), except that the term corresponding to Eq. (5.9b), which comes from the 
variation of the factor C in Tr{(7, i cS }W, is absent. Dropping this term from Eq. (5.14b), re- 
placing {C, i cS } on the right hand side by —2h and factoring away —h, and using Eq. (5.10b) 
to simplify the final term on the right, we get 

with Kes S iven b y 




(5.24c) 
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Correspondingly, after variation of source terms, instead of Eq. (5.16b) we now get 

(S L (xtes) ^2S(x rcS , r ^u; V ' x ueS ) S R (x teS )) aVo = , (5.25a) 

u 

with Vxues given by 



Vxucfi =(-rx ucS + iri£ u x ucS )W 

'$W\ (5.256) 
Sx s J eS 



a;,, 



us 

s 



It is apparent from Eq. (5.25b) that we cannot make an approximation of neglecting 
both the i] term and the r term on the right hand side, since this would lead to the incorrect 
conclusion, for example, that 



\Sx s ) 



>av,o = (5.26a) 

cff 



for general W. In other words, assumption (1) of Sec. 5C, which we recall states that 

Tx ueS TrC cS i eS W e{ { = Tx ucS TrC eS i cS W (5.266) 

can be neglected, cannot be extended to the assumption that the corresponding expression 
obtained by replacing C e s by its ensemble average i c sh can also be neglected. This does not 
invalidate the reasoning of Sec. 5C, but does place constraints on the support structure of 
the underlying trace dynamics. To give a simple illustration, if / and g are non-negative 
functions, the vanishing of the the average (/<?)av over a domain including the supports of 
/ and g does not contradict the fact that ((/)avA , )av = (/)av(<?)av is nonzero and positive; 
what is necessary and sufficient to achieve the vanishing of the former is for / and g to have 
nonintersecting domains of support, so that / = where g > and vice versa. We are 
faced with a similar situation with respect to C e s, which although not of definite sign has, 
by assumption, a nonvanishing canonical ensemble average H. A sufficient condition for us 
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to be able to neglect Eq. (5.26b), without contradicting Eq. (5.25b), is for x ucf[ and C cS to 
have disjoint domains of support, which is why we have phrased assumption (1) in terms of 
support properties. 

At the same time, we cannot impose this property by requiring the stronger condition 
that x ue f{ and C e & have disjoint support, since this would contradict assumption (3), which 
states that {C, i c s} can be replaced by its ensemble average in the final term in Eq. (5.15a). 
Thus, what is required is that the "slow" components of x uc s, for which rx ue s is effectively 
zero, share a common domain of support with C e s, and be slowly varying with respect to 
the scale of variations of (7 e ff, so that in "slow" terms in the Ward identity C e s is effectively 
equal to its ensemble average. At the same time, we must require that the "fast" components 
of x ucf[ , for which x ueff is significant, have disjoint support from C cf[ , so that the ensemble 
average of their product is effectively zero. To see that these requirements are compatible, 
and suffice to do what is needed, let us write 

x rcS = xf^ + , (5.27a) 

and postulate that C^s has disjoint support from x^s- Then in the final term of Eq. (5.15a) 
we have 

(w s m ±{C : i e{i }W s A = (w s Risl ™±{C, icS }W s Lesl °A , (5.276) 

\ / eff \ — /eff 

so that the "fast" terms do not appear in this expression, and we can then apply assumption 
(3) to replace C e s by i e gh in this term. Similarly, by the assumed support properties, 

rx rcS Tm cS C cfi W eS = rxf^Trt cfi C cS W:^ ~ , (5.27c) 
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but on the other hand 

rx rcS TrW = rx reS TrW ef{ =r(xf^ + j*g)Tr(Wg« + W^ st ) 

(5.27d) 

~Ta*£Tr(Wg" + W^) ^ , 
so the additional Ward identity derived in Eq. (5.25b) can be satisfied. 

More specific statements of our assumptions (1) and (3) can be given if we specialize 

the underlying trace dynamics (i) to the supersymmetric case, where the numbers % and 

np of bosonic and fermionic degrees of freedom are equal, and (ii) to the specific case of 

supersymmetric Yang-Mills theory, where we have seen in Sec. 3B that C reduces to a surface 

integral at spatial infinity. Following the notation of Eq. (4.41b), let us write x r = x re s+x r i 2 , 

which when substituted into Eq. (2.6) for C gives 

C = L0 rs (x re ffX se ff + X re ff X s 12 + X r l2^scfT + x r 12 x s 12 ) • (5.28a) 

r,s 

Taking the effective projection, and using Eq. (4.41c), which implies that (x s i2) c ff — ( x ri2) c s = 
0, we get 

C c s = ^2^rs(x rcS x sefi + (x rl2 x sl2 ) c s) ■ (5.286) 

r,s 

The first term on the right hand side in Eq. (5.28b) can be rewritten as 

^2uJ rs X rcS X scS = ^2[q r eS,Prcs] - ^{<?rcfr,Prcfr} • (5.28c) 

r,s r,B r,F 

Within ensemble averages, we have seen that the commutators and anticommutators in 
Eq. (5.28c) have the effective canonical values given in Eqs. (5.21b,c), and so within averages 
Eq. (5.28c) is effectively (ub — np)i c sft-, and we have 

CcE - (n B - n F )i cS + ^2u rs (x rl2 x s i 2 ) c s , (5.28a 1 ) 

r,s 

with ub and % respectively the number of bosonic and fermionic matrix degrees of freedom. 
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We can now apply this equation in two ways. First of all, taking its ensemble average 
we get 

i cS h ~ (n B - n F )i cS + (^2uj rs (x rl2 x sl2 ) eS )j^ fi . (5.29a) 

r,s 

This shows that if the difference % — rip becomes infinite, then there is an inconsistency 
unless the second term in Eq. (5.29a) becomes large in such a way as to cancel the infinite 
part of the first term. This is implausible, and so we conclude that consistency of our 
approximations requires that % — % should be finite, even when tib becomes large. (A 
more precise version of this argument for boson-fermion balance will be given shortly.) 
Specializing now to the case of supersymmetric theories, for which % is exactly equal to 
np, the first term on the right in Eq. (5.28d) vanishes, and we get 

C c s -^2u rs (x rl2 x sl2 ) c fi . (5.296) 

r,s 

From this equation, we see that a sufficient requirement for the assumed support properties 
is that x^fi should have disjoint support from x s u for all u,s, while x s ^°g should have a 
common support with x s i 2 , in such a way that C c s can be replaced by its ensemble average 
in expressions involving "slow" quantities. From Eq. (5.29a) with n B — rip = 0, we see that 

^efffi- (y^^rs(^rl2^12)eff)AV.O ■ (5.29c) 

r,s 

Since i e & anticommutes with x r \ 2 and with x sU , it commutes with the right hand side of 
Eq. (5.29c), as required by the structure of the left hand side. 

We have learned from this that the quantities for which disjoint support is required are 
distinct components under the separation into "eff" and "12" components of Eq. (4.41c). 
A further distinction is present in supersymmetric Yang-Mills theories, in which we have 
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seen that C reduces to a surface term at spatial infinity, giving the emergence of quantum 
mechanics in these theories a "holographic" flavor. (For a review of recent ideas on a possible 
holographic structure of physical theories, see [26].) The degrees of freedom x r which describe 
observable physics are then degrees of freedom residing in the interior volume, whereas the 
components x r u entering into Eq. (5.29b) reside on the surface at infinity. For such theories, 
the required support properties state that for volume degrees of freedom, x^ should have 
disjoint phase space support from degrees of freedom x r yi residing on the surface at spatial 
infinity, while the volume degrees of freedom xf^ 1 should have a common support with the 
degrees x r u residing on the surface at infinity and should be slowly varying relative to C e s. 
(Recall that the distinction between volume and surface here refers to operator labels r, 
and does not directly translate into support properties in the operator phase space.) These 
statements are as far as we have been able to carry a general analysis of the needed support 
properties. A further understanding of whether they can be realized will require a study of 
specific models for the underlying trace dynamics; constructing realistic candidates requires 
a solution to the hierarchy problem, and so will not be a simple matter. At a minimum, what 
our analysis has accomplished is to show that the support properties needed for assumptions 
(1) and (3) are not contradictory, and so cannot be used in any obvious way to construct an 
argument falsifying our program. 

The support properties required for the emergence of quantum behavior can also be 
characterized in physical terms as the requirement that the canonical ensemble should possess 
a certain "rigidity", in the sense that the contribution of the ensemble variation ( y 5p/5x s ) e {[ 
can be neglected in deriving the Ward identities. The need for a rigid statistical ensemble 
in our context suggests a possible analogy with the concept of London rigidity in the theory 
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of superconductivity. In the presence of an applied vector potential A, the induced current 
density j in a metal is given by 



with n, m, e,p respectively the electron density, mass, charge, and three momentum operator. 
In a normal metal the two terms on the right hand side of Eq. (5.29d) nearly cancel, leaving a 
small residual diamagnetism. However, in a superconductor the rigidity of the wave function 
leads to the vanishing of (p ), giving perfect diamagnetism and the Meissner effect. An 
analogy with the analysis of this section would equate normal metal behavior with the case 
in which C can be replaced by its ensemble average in all terms, including the r term, in the 
Ward identities; in this case — % times the right hand side of Eq. (5.24c) is equal to the non- 
commutator part of the right hand side of Eq. (5.15a) when the sources j s are set equal to 
zero, leading to vanishing of the emergent canonical commutator/anticommutator and to an 
effective classical dynamics. Similarly, the analogy would equate superconducting behavior 
with the case in which the r term containing C can be dropped because of "rigidity" of 
(5p/5x s ) e fi, leading as seen in Sec. 5C to an emergent canonical commutator/anticommutator 
as an analog of the superconductive Meissner effect. In this analogy, the Planck energy and 
the associated energy scale hierarchy would play the role of the superconductive energy gap. 
We suggest that this analogy may be useful in identifying the particular underlying trace 
dynamics for which the assumptions needed for emergent quantum mechanics are realized. 

We turn now to deriving a more precise statement [8] of the requirement of boson - 
fermion balance, which we achieve by deriving yet another Ward identity. This is obtained 
by proceeding as we did starting from Eq. (5.5a), but with {C, i e s} replaced by C in the trace 




(5.29d)) 
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factor Tr{C, i e g}W, so that this factor is taken now as TrCW. The derivation parallels that 
leading to Eqs. (5.11b,c), except that the term corresponding to Eq. (5.9b), which comes 
from the variation of the factor C in Tr{C, i c s}W, becomes now Tr[W, ^ r u rs x r ]5x s . Making 
the corresponding replacements in Eq. (5.11b), we get the Ward identity 

(£';> aVj =0 , (5.30a) 

with £" given by 

T!' s =(— [A, uj rs x r ] — t uo rs x r — irj oj rs x r — j s )TrCW 

r r r /_ or)U\ 

+ [W^rsX r }+^ W s m CW s U . 
r I 

We now follow a different procedure from that used in Sec. 5A, by immediately taking the 
sources j to vanish, and by not taking an overall effective projection. The contribution to 
the Ward identity of the first term on the right hand side of Eq. (5.30b) can be rewritten as 

-[\,(J2^rsXrTrCW} Kwfi } = , (5.30c) 

r 

since the zero source expectation inside the commutator in Eq. (5.30c) is a function of the 
operator A and no other operators, and so its commutator with A vanishes. Multiplying 
by uj us and summing over s, and evaluating the sums using Eqs. (5.13a,b), in place of 
Eqs. (5.14a,b) we now get the Ward identity 

(AlffWo = , (5.31a) 



with given by 



K=(-rx u + t^uX u )TrCW 

(5.316) 



+[W,x u ]+J2"u S eeW s m CW ! 



L£ 
s 
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Let us now apply this to the particular choice W = a t x t , with a t again an auxiliary 
c-number parameter which is a complex number for t bosonic, and a complex Grassmann 
number for t fermionic. Then (cf. Eqs. (5.10b,c)) we have only one term in the sum over £, 
with ee=i = 1, W^ e=1 = a t 5 st , and W^ e=1 = 5 st , so that the final term in Eq. (5.31b) reduces 
to 

u ut Ca t , (5.31c) 

and has the ensemble average 

u ut i cS ho- t . (5.31(f) 

Hence in this special case the Ward identity of Eqs. (5.31a,b) reduces to 

= ((-tx u + ir]£ u x u )TrCa t x t ) KYfi + ([a t x t , x u ]) Kvfi + uj ut i cS ha t . (5.32a) 

Since the final two terms in Eq (5.32a) are manifestly traceless, and since C is traceless, 
projecting out the traceless part of the first term using the notation of Eq. (2.16a), and 
rearranging terms, we arrive at [8] 

([x u , <7 t x t ]) AV)0 = i ef fhuj ut a t + ((-tx' u + iriZ v x , jTrC<T t rft)/Cv,o ■ (5.326) 

Letting the indices t and u in Eq. (5.32b) be either both bosonic or both fermionic, and 
in the fermionic case, for simplicity, setting the "chemical potential" 77 equal to zero (it is 
easy to extend the analysis to rj ^ 0), we get the respective relations 

(5.33a) 

({<?r,Pr}) A v,o =icsh ~~ T (<l'r TT Cp'r} av,o r fermonic . 
Substituting this into Eq. (2.6) for C, taking the ensemble average, and using Eq. (4.11b), 
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we get 

(5.336) 

=(E-E)^-^(E-E)^ Tr ^)AV,o • 

r,B r,F r,B r,F 

After division by h, transposition of terms, and use of E r) £i = ub , S rj i?l = rip, this gives 
E-E)^ V ^ Tr ^)AV,o=^(n B -n F -l) . (5.33c) 

r,B r,F 

When the condition of approximation (1) of Sec. 5C is satisfied, the left hand side of 
Eq. (5.33c) is a sum of very small terms. Assuming that this sum yields at most a finite, 
bounded total, let us consider the case in which r includes the spatial label of a translation 
invariant field theory. Then the number of bosonic and fermionic modes per unit volume 
contributing on the right hand side of Eq. (5.33c) must be equal, since if not, the right hand 
side of Eq. (5.33c) would become infinite as the spatial volume grows to infinity, contradicting 
the boundedness of the left hand side. Therefore, a trace dynamics that is a candidate pre- 
quantum mechanics must have equal numbers of bosonic and fermionic degrees of freedom 
(up to a finite residue). This is a much weaker requirement than supersymmetry, but of 
course is always satisfied by supersymmetric theories. When the numbers of bosonic and 
fermionic modes are in balance, Eq. (5.33c) simplifies to 

E - D ft ~M#™V r > A V,o = -*eff , (5.33d) 

r,B r,F 

showing that the rx r terms neglected in making approximation (1) sum in Eq. (5.33c) to 
give a total of unit magnitude. 

The above analysis of boson-fermion balance has implications for the behavior of C in the 
thermodynamic limit of large system size. Although the bosonic and fermionic contributions 
to C each grow linearly with the size of the system, the near cancellation of their contributions 
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to C suggests that the total rate of growth of C could be much smaller than those of the 
bosonic or fermionic parts taken separately. Hence, even though C is formally an extensive 
thermodynamic quantity (it is additive for disjoint subsystems), it may remain bounded, or 
have much smaller than a linear rate of growth, as the system size gets large. In the first case 
h would remain bounded in the limit of large system size, while in the second case h could 
still be a weakly increasing function of system size; our general analysis does not determine 
the expected behavior. 

5E. Derivation of the Schrodinger Equation 

In Sec. 5C we have argued that the statistical thermodynamics of matrix models with 
a global unitary invariance leads to an emergent Heisenberg picture quantum mechanics. In 
this section we shall make the transition to the corresponding Schrodinger picture formula- 
tion. We take as our starting point the correspondence of canonical ensemble averages to 
operators in an effective quantum theory given in Eq. (5.23a). Transcribing the canonical 
commutators inside averages of Eqs. (5.21a-c) into operator statements, we get 

[X ucS ,(T t X tcS ] = i cf[ hu ut (Jt , (5.34a) 
which encodes the canonical commutators 

[QueS, Qtes] = [PueK,Ptes] = , [QueS, Ptcs] = i e S^ut (5.346) 

for u, t bosonic, and the effective canonical anticommutators 

{QueS, Qtcs} = {PucS, Ptctt} = , {QueS, Ptes} = ieS^ut (5.34c) 

for u, t fermionic, with all boson-fermion commutators vanishing. Similarly, the operator 
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transcription of Eqs. (5.19b) and (5.15c) for the time evolution of x uc s becomes 

X uc g = i c ffh 1 [H cS , X ucS ] , (5. 34c() 

which extends by the chain rule to 

S'eff = iegh'^Hes, Seg] , (5.34e) 

with S e fi any polynomial function of the operators {X re s}. 

Before turning to the transition to the Schrodinger picture, we first discuss consistency 
issues raised by treating the fermionic anticommutators as operator equations. If we assign 
fermionic adjoint properties as in Eq. (2.4b), which has the operator transcription 

Qrcff = ^rcflf j PrcS = ^ re S ' (5.35a) 

then the nonvanishing anticommutator in Eq. (5.34c) takes the form 

{^ucs, *Lf} = -HeshSut ■ (5.356) 

In the K dimensional subspace of Hilbert space on which i eff acts as ±i, Eq. (5.35b) takes 
the form 

{* ueff , *f eff } = ±kS ut . (5.35c) 

The + sign case of Eq. (5.35c) corresponds to the normal field theoretic fermionic anticom- 
mutator, but the — sign case is inconsistent: Setting u = t, the — sign case gives 

{% eS ,V\ eS } = -h , (5.35d) 

which is not possible because the left hand side of this relation is the sum of two positive 
semidefinite operators. Therefore the operator transcription of Eq. (5.23b) must be modified 
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to include an extra — sign in ty] eS in the i e ff = — i sector; in other words, a consistent form 
of the operator transcription for fermions is given by 

<?reff <-> QrcS = ^rcS , Preflf ^ T 3 P rcS = «T 3 ^ eff = ieff^Lff > (5.36a) 

with T3 the 2x2 matrix introduced in Eq. (4.40). Correspondingly, the nonvanishing anti- 
commutator in Eq. (5.35b) is changed to 

{* veS ,*t, s } = h5 ut , (5.366) 

which has the correct positive sign on the right in both the i e s = ±i sectors of Hilbert 
space. The presence of an extra factor r 3 with eigenvalues ±1 in the consistent operator 
transcription of Eq. (5.36a) can be viewed as a reflection of the fact that the use of i instead 
of —i in the adjointness assignment of Eq. (2.4b) was completely arbitrary: with either 
p r = iipr of p r = —iip r , a self-adjoint Lagrangian and an anti-self-adjoint C are obtained. 

Turning to the boson sector, let us now introduce effective bosonic creation and annihi- 
lation operators in the effective quantum theory, denoted by A rcS and A\ cS , by writing 

Qreflf = -^(AeG + Kcs) > PrcS = —^{A rcS ~ A^) . (5.37d) 

Since i e g commutes with all effective operators, the definition of Eq. (5.37a) is clearly consis- 
tent with the self-adjointness of Q r and P r . Rewriting the commutator algebra of Eq. (5.34b) 
in terms of A rc s and its adjoint, we get 

[A ucS , A tcS ] = [Al eS , A\ cS ] = , [A ucS , A\ cS ] = U ut , (5.376) 

which, as was the case in Eq. (5.36c), has the correct positive sign on the right in both the 
i e ff = =ti sectors of Hilbert space. Note that again a factor of i e s appears in the transfor- 
mation from Q r ef{ , -Preff to the corresponding creation and annihilation operators (which 
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for both fermions and bosons, as defined above, differ by a factor of a 5 from the customary 
ones) . 

We are now ready to discuss the transition from our emergent Heisenberg picture quan- 
tum mechanics to the Schrodinger picture, and to derive the usual nonrelativistic Schrodinger 
equation. Since the Heisenberg equation of motion of Eq. (5.34e) and the commutation re- 
lations in the form given in Eqs. (5.36b) and (5.37b) have the standard quantum mechanics 
form, what we do now is standard quantum mechanics, and makes no explicit reference to 
emergent origins of the quantum equations. Restricting ourselves to the case in which the 
effective Hamiltonian has no intrinsic time dependence, we define U e s(t) by 

U cS (t) = exp(-i c{f h~HH cS ) , (5.38a) 

so that 

^U eS (t) = - iesh' 1 H eS U ef£ (t) , 

™ (5.386) 

jUAtf =t cS n^u cfi (tyH cS . 

Then from the time- independent Heisenberg picture state vector ip and an operator S e s(t) 
with no intrinsic time dependence, we can form a Schrodinger picture state vector -^Schr and 
operator S e g schr by the usual construction, 

^SchrW =U e f{(t)lp , 

(5.39a) 

S C S Schr =U c s(t)S e s(t)U c fi(t)^ , 

giving 

i e sh^-ipschr(t) =H cfi ip Schr (t) , 

dt d (5.396) 

^^eff Schr =0 • 

To derive the nonrelativistic Schrodinger equation, let us consider the spacetime con- 
tinuum case in which r is the label x, so that the fermionic anticommutation relations of 
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Eq. (5.36b) take the form 

{^ cS (x),^ cfi (y)} = h6 3 (x-y) . (5.40a) 

Assuming that the nonrelativistic operator \& e fr annihilates the vacuum state |vac), so that 

# eff (£)|vac) = , (5.406) 

and sandwiching Eq. (5.40a) between (vac| and |vac) gives 

(vac|^ cff (f)^ ff (y)|vac) = h5 3 (x - y) . (5.40c) 

In the bosonic case, we start from the bosonic commutation relation of Eq. (5.37b), and 
assuming that the nonrelativistic operator A cS annihilates |vac), we end up with 

(vac\A cfi (x)Al s (y)\vac) = h5 3 (x-y) , (5.40d) 

which has the same form as in the fermionic case. So it suffices to restrict ourselves henceforth 
to the fermionic case. 

Let us now introduce a complete set of single fermion intermediate states into Eq. (5.40c), 
by inserting 1 = J2 n \n)(n\, giving 

^(vac|* e ff(£)|rc)(n|^ ff ($|vac) = h6 3 (x - y) . (5.41a) 

n 

If we now define a wave function ^ n {x) by 

hH n (x) =(vac|^ cff (f)|n) , 

%H* n {x) =(n|*t ff (x)|vac> , 
then after dividing by h Eq. (5.41a) can be rewritten as 



(5.416) 



J2K(^n(y) = S 3 (x-y) , (5.41c) 
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which is the usual completeness relation in coordinate representation. Multiplying by J d 3 y^* m (y), 
we get 

5>;(a9 / d 3 y^ m (y)^ n (y) = V m (x) , (5.41d) 

which by linear independence of the ty n tells us that 

Jd 3 y^* m (y)^ n (y)=5 mn , (5.41e) 

which is the orthonormality condition in coordinate representation. Taking the time deriva- 
tive of the first line of Eq. (5.41b) and using the Heisenberg equation of motion of Eq. (5.34d), 
we get 



U*^ n (x) (vac jty, v)\n) 



(5.42a) 



= (vac\i cS h 1 [H eB ,^ eB (x)]\n) . 
If we take H eS to be a one body operator of the form 



H cS = J d 3 y¥ cS {y)n^mo^y) , (5.426) 

then the commutator appearing in Eq. (5.42a) is given by 

[H eS ,V eS (x)] = -H eS (x)V eS (x) , (5.42c) 

and so the right hand side of Eq. (5.42a) becomes 

-i eff ^ _1 Kff(^)(vac|*efr(^)|n) = -i e shr^n e s{x)^ n {x) ■ (5.42d) 

Multiplying through by i e s^ , Eq. (5.42a) then yields the standard nonrelativistic Schrodinger 
equation in coordinate representation, 

i e sh^ n (x) = H eS {x)^ n {x) . (5.43) 
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This is of course all standard quantum mechanics and quantum field theory. The point 
of going through it in detail is to emphasize that once we have obtained emergent canonical 
commutation relations and an emergent Heisenberg equation of motion for operators, the 
Schrodinger picture and Schrodinger equation of quantum mechanics follow in a straightfor- 
ward way. To complete the argument for an emergent quantum mechanics, we must address 
the issue of how the probability interpretation (the Born rule) follows from our framework; 
this is the topic of the next section. 



Up to this point we have worked in the thermodynamic limit, with our reasoning based on 
the study of averages of dynamical variables in the canonical ensemble, with all fine grained 
structure averaged out. However, as in classical statistical mechanics, there are contexts 
in which fluctuations around the averages, which can be modeled in a natural way by a 
generalized Brownian motion, are important. We shall argue in this section that Brownian 
motion corrections to emergent quantum mechanics provide the mechanism responsible both 
for reduction of the state vector, and for the emergence of the Born and Liiders probability 
rules. 

To do this, we shall return to the general Ward identity of Eqs. (5.15a-c), in which the 
source terms have been varied and then set equal to zero. We continue to make approxima- 
tions (1) and (2) of Sec. 5C, that is, we neglect the r and rj terms in Eq. (5.15a), but now 
we do not make approximation (3), so that Eq. (5.15a) takes the form 



5F. Brownian Motion Corrections to Schrodinger Dynamics 



and the Emergence of the Probability Interpretation 




eflf 



(5.44a) 
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and Eq. (5.15c) states that this expression vanishes inside suitable canonical ensemble aver- 
ages. (To recapitulate some terminology, i e ff is defined, together with h, from the ensemble 
average of C in Eq. (4.11b); W is a general bosonic polynomial in the matrix dynamical 
variables {x r }; the effective of "eff" projection is defined in Eqs. (4.41a-d); the structure 
coefficients oo us and the grading factor q are defined in Eqs. (1.16a,b) and the line following 
Eq. (1.10b), respectively; and finally, the decomposition of W into left and right factors W^ e 
and Wf 1 with respect to x s is defined in Eq. (5.10a).) We shall now proceed in two steps: 
first we study the implications of Eq. (5.44a) for the normalization and completeness of wave 
functions at a fixed initial time, and then we study its implications for the time development 
of wave functions, that is, for the Schrodinger equation derived in Eq. (5.43). 

For the first step we observe, recalling the discussion preceding Eq. (5.31c), that if we 
take W = a t x t , then there is only one term in the sum over £, with q=i = 1, W^ e=1 = a t S st , 
and W^ e=1 = 5 st , so that the final term in Eq. (5.44a) reduces to 

uJut^{C,i cS }(T t . (5.446) 

Without making further approximations, this term has zero source ensemble average 

-u} ut hcr t , (5.44c) 

and so setting the sources equal to zero in Eq. (5.15b), we get 

(i e sWtXteS,x ue a] - u ut ha t )^ yfi = . (5.45a) 

Multiplying Eq. (5.45a) on the left by ipl and on the right by ip , and assuming the correspon- 
dence between canonical ensemble averages and Wightman functions given in Eq. (5.23b), 
we see that 

(vac\i cS [a t X tcf[ , X ucS ] - uj ut ha t \v&c) = . (5.456) 
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Using Eq. (5.45b) in place of Eq. (5.34a) as the starting point for the analysis of Sec. 5E, 
we learn that the vacuum expectation of Eq. (5.40a), 

(vac|{^ cfr (f),^ ff (y)}|vac) = h5 3 (x-y) , (5.45c) 

does not make use of approximation (3), in other words, Eq. (5.45c) holds even when fluctua- 
tions of C about its ensemble average are taken into account. Thus, the orthonormalization 
and completeness of Schrodinger wave functions, derived in Eqs. (5.41a-e), also does not 
make use of approximation (3), as a result of the insensitivity of the vacuum expectation of 
the canonical algebra to fluctuations in C. 

For the second step, we take W in Eq. (5.44a) to be the operator Hamiltonian H, as 
we did in Eq. (5.19b) of Sec. 5C, but we now take the fluctuations of C about its ensemble 
average into account. We denote this fluctuating term by 

AC = C - (CV, , (5.46a) 
and following the notation of Eq. (4.41b), we write 

AC = AC cR + AC 12 . (5.466) 

We now make an Ansatz for the structure of the first term in Eq. (5.46b), 

AC cS = i cS hK, , (5.46c) 

where /C = /Co + is taken to be a complex c-number that is rapidly fluctuating, so that 
it has vanishing zero source ensemble average, 

(/C) AV ,o = . (5.46d) 
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Note that if /C is a c-number, then Eq. (5.46c) is automatically consistent with the general 
condition TrC = 0, and because we have seen in Sec. 2 that C can have a self-adjoint part, 
which can arise from time reversal noninvariance, the imaginary part JCi of the fluctuating 
term can be nonzero. When we form {i e s, C}, the second term of Eq. (5.46b) drops out, and 
so with the Ansatz of Eq. (5.46c) we get 

{C,i eff } = -2fi(l + /C) , (5.47a) 

with the term /C, which we assume to be much smaller than unity, giving the leading fluc- 
tuation correction to our earlier analysis. There will in general be higher order terms in 
the fluctuations, which can have a nontrivial operator structure, and so we shall include an 
0(/C 2 ) error term in the subsequent formulas. However, we shall see that general physical re- 
quirements determine much of the structure of these higher order terms, given the structure 
of the linear term. 

There are two possible dynamical scenarios for having a nonzero imaginary part K\. 
In the first scenario, C has an explicit self-adjoint part, as in the examples discussed in 
Eqs. (2.18a) through (2.22d). In this case, there will be an additional Lagrange multiplier 
term in the exponent of the canonical ensemble p, associated with conservation of the self- 
adjoint part of C, and the variation of this term will lead to an additional term in the 
Ward identity, which must be retained for consistency. In the second scenario, C remains 
anti-self-adjoint, so that the structure of the Ward identity is unaltered, and the imaginary 
part /Ci in the fluctuation term appears because of spontaneous breaking of time reversal 
symmetry. In this case, consistency requires the canonical ensemble to contain an implicit 
boundary condition or contour prescription ie , e — > + (~), which selects the sign of 
the imaginary unit multiplying K\. 
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We shall assume that the second scenario is the relevant one, and so shall continue to 
use the Ward identity of Eqs. (5.15a-c), and the consequences derived from it in Sec. 5C. 
Since /C is a c-number, when Eq. (5.47a) is substituted into Eq. (5.44a), we can still use 
Eq. (5.10b) to evaluate the sum over £, just as we did in Eq. (5.18c), giving 



Taking W to be the operator Hamiltonian H, we now find that Eq. (5.19b) is replaced by 



which is still to be interpreted as an equality holding when sandwiched between polynomials 
Sl,r that do not contain x u , and averaged over the zero source canonical ensemble. 

We now wish to reinterpret the vanishing of Eq. (5.47c) as an operator statement in 
the effective quantum field theory, using the correspondence of Eq. (5.23a), and restricting 
ourselves henceforth to the i c s = % sector. Since /C is a rapidly fluctuating quantity in 
the underlying matrix operator phase space, it does not have a direct transcription to the 
effective field theory. However, consistent with the idealization involved in describing an 
ergodic, time dependent matrix dynamics by the static canonical ensemble, it is natural 
to model /C in the effective field theory transcription of Eq. (5.47c) as a time dependent, 
rapidly fluctuating complex c-number noise term K,(t). Hence we provisionally reinterpret 
Eq. (5.47c) as a field theory equation of motion 




(5.476) 



Vx ueS = i e ft[H eS , x uc{{ ) - h(l + K)x ueS + 0(K, 2 ) 



(5.47c) 



i eS [H eS , X ucS ] - h(l + 1C(t))X ueS + 0(/C 2 ) = 



(5.47d) 



Rewriting this as 



X ucS =i eS h-\l - lC{t))[H eS ,X ueS } + 0(K?) 



(5.47e) 



i cS h-\l - IC (t))[H cfi ,X ucfi } - ii^K^H^X^ + 0(/C 2 ) 
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we see that the K,i(t) term in X ue g has the opposite adjointness from X ue s, that is, if X ue g 
is self-adjoint then the )Ci(t) term in X uef[ is anti-self-adjoint, and vice versa. As a result, 
there is an inconsistency if we regard Eq. (5.47e) as an operator equation of motion that 
holds for all operators X uc s, since if we replace X ue s in Eq. (5.47e) by its adjoint j| cff , and 
then take the adjoint of Eq. (5.47e), we obtain an equation for X ue s in which the sign of the 
/Ci term is reversed. (A further discussion of this problem is given in Appendix H.) 

We can avoid this inconsistency in the same manner that the problems with imposing 
a covariant Lorentz gauge constraint are avoided in quantum electrodynamics, by regarding 
Eq. (5.47e) not as an operator equation of motion, but as a constraint on the vacuum state 
| vac), so that we have 

A ucfr |vac) = i cS h-\l - /C(t))[# cff ,X Mcfr ]|vac> + 0(/C 2 ) . (5.47/) 

Since we are assuming that H e g\v&c) = 0, this equation simplifies to 

Xcslvac) = ieffTT^l - /C(t))# cff X Mcfr |vac> + 0(/C 2 ) . (5.47$) 

When X uef[ is an annihilation operator ^/ uc s or A uef[ , the left and right hand sides of 
Eq. (5.47g) are equal to zero and the equation becomes trivial. However, it has nontriv- 
ial content when X uc g is a creation operator ^ ueff or A\ cS . Similarly, taking the adjoint of 
Eq. (5.47g), we get 

(vac|Al ff = (vacl^tfeffHefO^a - K?(t)) + 0(/C 2 ) , (5.47/*) 

which is trivial when A^ efr is a creation operator and nontrivial when it is an annihilation 
operator. 
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Using Eq. (5.47h), projected on a general state |...), in the Schrodinger equation deriva- 
tion of Eqs. (5.42a-5.43), we obtain 

= -ihTHl - K,*(t))H eS (x)$(x) + 0(/C 2 )$(f) . (5.48a) 

at 

We have here denoted a generic state vector by $ rather than by \l/ n . We have dropped the 
basis label n because it is irrelevant for the present discussion, and have used the notation 
$ rather than \1/ to emphasize the fact that when the imaginary part of K,(t) is nonzero, 
Eq. (5.48a) does not preserve the norm of the state vector $. The fact that the norm of $ is 
not preserved, we suggest, is a reflection of the approximation involved in transcribing the 
time independent /C that fluctuates over the underlying operator phase space into a time 
fluctuating process K,(t) in the effective field theory. 

Since we have seen that the orthonormality structure of state vectors at an initial time t = 
is preserved in the presence of fluctuations in C, and moreover, since in the nonrelativistic 
limit all particle species are conserved in number, we must restore conservation of the norm 
under time evolution in order to obtain the physical state vector A norm preserving 
Schrodinger equation, incorporating the fluctuation corrections, can be obtained by making 
a suitable choice of the 0(/C 2 ) term in Eq. (5.48a) and then identifying the physical state \l/ 
with the renormalized $, 

^ = r . (5.486) 

[/ a%<3>* (£)$(£)] 2 

To complete the specification of the stochastic dynamics for $, we must also specify the 
nonvanishing time averages (which we denote by E [...]) of the rapidly varying noise term, 
by writing 

E[K A (t)] = 0, E[)C A (t 1 )lC B (t 2 )} = 5 AB D A (t 1 -t 2 ) , A,B = 0,1 , (5.48c) 
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where the Da are certain specified functions, which in the case of white noise are constants 
times delta functions. 

Equations (5.48a-c) summarize our basic results for the fluctuation modified Schrodinger 
equation. In essence, what we have found is that the fluctuations of C have the effect of 
replacing the Planck constant % in the Schrodinger equation by a new Planck "constant" 
h(l + /C) that has small complex random fluctuations. Although we have not specified the 
0(/C 2 ) term, once the part of Eq. (5.48c) linear in /C is given, the 0(/C 2 ) term in the white 
noise case is completely determined by general structural considerations. The easiest way 
to see this is to go over to a standard Ito calculus representation of the fluctuation term, by 
writing 

ih^TC^dt = [3 R dW t R + ifcdWt , (5.49a) 

where (3rj are real constants and where dW t R and dW{ are stochastic differentials that, 
together with dt, obey the usual Ito calculus rules (see also Appendix G) 

(dw t R ) 2 =(dw!) 2 = dt , 



dW R dW t T =dW R dt = dWldt = dt 2 = . 



(5.496) 

--dt 2 = . 

Writing $(x) = Eq. (5.48a) then takes the form 

d|$) = -ih- l H cS \<$>)dt + 0(l3 2 )\<$>)dt + (3 R H eS \$)dW R + ifcHes^dWl . (5.49c) 

Using the standard Ito product rule (or stochastic integration by parts formula) given by 

d(FG) = (dF)G + FdG + dFdG , (5.49d) 

it is then straightforward to show [27] that up to an overall constant phase, the normalized 
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state vector corresponding to Eq. (5.49d) satisfies the stochastic differential equation 

= -ih- 1 H ef[ \*)dt+ [Q - (Q) - l-PUHcs - (H cS )) 2 - UjH 2 eS ]\m)dt 

1 1 (5.50a) 

+P R (H cS - (H eS ))\y)dW t R + i{3jH cS \m)dWl , 
where (O) denotes the expectation of the operator O in the normalized state \%), 

(O) = . (5.506) 

In Eq. (5.50a), Q is an arbitrary self-adjoint operator of order 0(f3 2 ) which is not determined 
by the requirement of norm preservation. However, a simple calculation [28] using Eq. (5.49d) 
shows that the evolution of the density matrix p — |^ f )(^ r | corresponding to Eq. (5.50a) is 

dp ^ih-^H^dt - l\P\ 2 [H cS , [H eS ,p\}dt + [p, [p,Q]]dt 

1 (5.51a) 

+P R [p,[p,H eS ]]dW t R + ip I [H eS ,p]dW t I , 
which when we take its expectation (i.e., averaging over the fluctuations) gives the ordinary 
differential equation 

^1 = %H-i[E\p\,H«\ - \\(3\ 2 [H C ^ [H eS , E[p]]] + E[[p, [p,Q]\] . (5.516) 

There are now two independent structural arguments for imposing the vanishing of Q. 
First, when Q is not zero, Eq. (5.51b) implies that the expected value of the energy E[TipH cS ] 
is not conserved, but instead obeys 

j t E[TrpH c{i } = E[Tr\p, [p, Q]]H cS ] + . (5.51c) 

Thus, to achieve energy conservation in the mean we must take Q = 0. Second, when Q is not 
zero, the evolution of Eq. (5.51b) is nonlinear, which opens up the possibility of instantaneous 
(faster than light) signaling [29]. If we assume that the underlying matrix dynamics has a 
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structure that forbids superluminal signaling in the emergent quantum theory, then we must 
again set Q = 0. 

With Q = 0, the stochastic expectation E[p] then obeys a linear master equation of the 

Lindblad [30] type characteristic quite generally of open system dynamics. Thus, although we 

have not explicitly calculated the 0(/3 2 ) term in Eq. (5.49c), general structural requirements 

lead to the unique norm-preserving stochastic equation 

= - ih-'H^dt - hp 2 R (H cS - (H cS )) 2 + (3 2 jH 2 cS \\m)dt 

1 (5.51<2) 

+(3 R (H eS - (H eS ))\V)dW t R + i(3jH cS \m)dWl , 
with the corresponding density matrix evolution 

dp = ih-\p,H cS }dt- l -\P\ 2 [H cS , [H cS ,p}}dt + (3 R [p, faH^dWf+iPAH^fidW* . (5.51e) 

Through Eqs. (5.48a-c) and Eqs. (5.51d,e), we establish a connection between the quan- 
tum dynamics emergent from matrix model dynamics, and a large body of literature dealing 
with stochastic modifications to the Schrodinger equation. We shall not attempt to review 
the stochastic Schrodinger equation literature here. For recent reviews focusing on the spon- 
taneous localization approach and references, see [31], and for detailed mathematical and 
phenomenological studies of the case in which the stochasticity is driven by the Hamilto- 
nian, as in the equations derived above, see respectively [28,32] and [33]. The connection 
between general Gaussian noise, and the simpler case of white noise, is discussed in [34]. 
The seminal ideas in the stochastic reduction program arose from work over the last twenty 
five years by Pearle [35], Ghirardi, Rimini, and Weber [36], Ghirardi, Pearle, and Rimini 
[37], Gisin [38], Diosi [39], and Percival [40], supplemented and extended in more recent 
work by many others. The main result coming from the stochastic Schrodinger program, as 
applied to Eqs. (5.51d,e), is that when the imaginary part JC\ of the noise term is nonzero, 
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corresponding in Eqs. (5.51d,e) to a nonzero real part Pr, then as it evolves the state vector 
reduces to energy eigenstates with the correct Born rule probabilities. An outline of the proof 
of this, focusing on the case of a nondegenerate Hamiltonian, is given in Appendix G. More 
generally, in the case of energy degeneracies, one finds [32] reduction in the generalized sense 
of the Liiders projection postulate. The phenomenological analysis of [33] (for a discussion 
see Appendix I) shows that reduction to energy eigenstates or degenerate energy manifolds, 
assuming a Planckian magnitude for the coefficient of the stochastic term and taking into ac- 
count environmental energy fluctuations, is compatible with all known experiments, both for 
cases in which the maintenance of coherence is observed, and those in which a measurement 
is made and state vector reduction results. These considerations strongly suggest that the 
statistical mechanics of matrix models with a global unitary invariance lead not only to an 
emergent complex quantum mechanics, but also to the emergence of the usual probabilistic 
framework needed for the application of quantum theory. 

Returning to Eq. (5.44a), which was the starting point for our analysis of stochastic 
reduction, we note that there is no obvious route for obtaining an analog of Eqs. (5.51d,e) in 
which H cf[ is replaced by a more general operator, such as one leading to spatial localization. 
The reason is that if we attempt to generalize beyond the Ansatz of Eq. (5.46c), by taking 
AC c f[ to be a general effective operator (rather than a c-number multiple of i e s), then 
{C e ff,i e fr} becomes an operator rather than a c-number, and it is no longer possible to use 
Eq. (5.10b) to evaluate the sum over £ in Eq. (5.44a) so as to give Eq. (5.47b). Consequently, 
when W in Eq. (5.44a) is taken as if e fr, in the case of a general operator fluctuation AC ef[ 
one no longer recovers the time derivative x ue s from the second term in Eq. (5.44a), and the 
route we employed to derive a stochastic time evolution equation is blocked. 
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One feature of stochastic Schrodinger equations that has led to much discussion in the 
literature is the fact that the usual formulations are nonrelativistic, and attempts to construct 
relativistic generalizations have encountered serious obstacles [41]. Within the framework 
given here, this is not surprising, since the canonical ensemble that we have used to derive 
emergent quantum mechanics picks out a preferred rest frame, which we have tentatively 
identified with the rest frame of the cosmic blackbody radiation. In the decoupling limit 
in which the r terms are neglected and in which fluctuations in C are neglected, we have 
argued that a Lorentz invariant effective quantum theory results when the underlying trace 
Lagrangian is Lorentz invariant. However, in order for fluctuations in the canonical ensemble 
to have a finite magnitude, the convergence factor exp(— rH) in the canonical ensemble is 
needed, and so fluctuation processes in the ensemble are necessarily frame- dependent. From 
this point of view, the frame-dependent structure of the stochastically modified Schrodinger 
equation is a natural feature. 
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6. Discussion and Outlook 



In the preceding sections we have developed a new approach to quantum mechanics, 
based on the idea that quantum theory is an emergent phenomenon arising from the statis- 
tical dynamics of an underlying matrix model with a global unitary invariance. What we 
have done is to establish a general framework, and to formulate specific assumptions and 
approximations, that lead to the emergence of quantum mechanics as an effective dynamics 
for low frequency or "soft" degrees of freedom, which are separated by a large hierarchy 
of scale and effectively decoupled, from very high frequency or "hard" degrees of freedom 
characterizing the underlying dynamics. However, we have not identified a candidate for the 
specific matrix model that realizes our assumptions: this is a task for the future. 

Since, as noted in the Introduction, quantum theory is our most successful physical 
theory, one can ask why try to replace it with something else? To conclude, we respond to 
this question by listing a number of problems with conventional quantum mechanics, that are 
solved, or may be solved in the future, by an approach along the lines of the one developed 
here. 

(1) What is the origin of "canonical quantization"? 

The standard approach to constructing a quantum theory consists in first writing down 
the corresponding classical theory, and then "quantizing" it by reinterpreting the clas- 
sical quantities as operators, and replacing the classical Poisson brackets by commuta- 
tors / anticommutators. However, since quantum theory is more fundamental than classical 
theory, it seems odd that one has to construct it by starting from the classical limit; the 
canonical quantization approach has very much the flavor of an algorithm for inverting the 
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classical limit of quantum mechanics. In the trace dynamics approach developed here, one 
works with operators from the outset, and the full structure of the canonical commuta- 
tion/anticommutation relations is derived as a reflection of the structure of the conserved 
operator C . 

(2) The quantum measurement problem. 

The unitary evolution of standard quantum mechanics does not describe what happens 
when measurements are made, but conventionally has to be supplemented by an additional 
postulate of nonunitary state vector reduction when a "measurement" is performed by a 
"classical" apparatus. In the emergent approach developed here, both unitary evolution and 
state vector reduction are seen to be different aspects of the underlying nonunitary matrix 
model dynamics. Unitary evolution of the emergent quantum mechanics reflects properties 
of the statistical thermodynamics of the underlying matrix dynamics, while the phenomenon 
of state vector reduction together with the Born probability rules arise as a consequence of 
Brownian motion corrections to this thermodynamics. 

(3) Infinities and nonlocality 

An outstanding problem in quantum mechanics (or more specifically, in quantum field 
theory) is the presence of infinities, and an outstanding puzzle is the nonlocality of quan- 
tum mechanics seen, for example, in Einstein- Podolsky- Rosen type experiments. In the 
emergent approach developed here, these are both aspects of an underlying dynamics that 
is totally nonlocal, as manifested in the fact that the underlying matrix variables have no 
assumed commutativity properties. These matrix variables are postulated to lead to con- 
vergent traces obeying the usual cyclic properties, and since the associated trace dynamics 
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is an extension of classical dynamics, it should involve no inconsistencies or infinities. The 
canonical local commutation/anticommutation relations of quantum field theory, with their 
corresponding short distance singularities, emerge only as an idealization approximating the 
thermodynamic limit of the underlying trace dynamics as it applies to the "soft" degrees of 
freedom. As already noted in Sec. 5C, because the underlying trace dynamics is a nonlocal 
"hidden variables" theory, it is not subject to the Bell inequalities that rule out attempts at 
local hidden variables extensions of quantum mechanics. We also remark that the nonlocal 
structure of the underlying dynamics may have significant implications for aspects of early 
universe cosmology, such as the horizon problem. 

(4) Unification of quantum theory with gravitation 

There are a number of indications that conventional quantum mechanics must be mod- 
ified in a profound fashion in order for it to be successfully combined with gravitational 
physics. In generic curved spacetimes, it is not possible to give a precise formulation of the 
particle production rate, nor is there necessarily a well-defined concept of conserved energy. 
In trace dynamics, there is no conserved energy operator, but only a conserved trace en- 
ergy H, suggesting that it may give an arena in which the properties of quantum mechanics 
and gravity can be reconciled. (We note that recent work on the string theory approach 
to quantum gravity has also suggested certain classes of matrix models as an underlying 
dynamics [42].) A second indication that quantum mechanics must be modified when com- 
bined with gravitational physics is provided by recent ideas on "holography" , which suggest 
that the association of degrees of freedom with volume subdivisions must break down near 
the Planck energy [26,43]. As we have noted, the fact that C becomes a surface integral in 
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super symmetric Yang-Mills theories suggests a possible connection between trace dynamics 
and holographic ideas. 

A third indication of possible new quantum physics in the gravitational context comes 
from the fact that in addition to ordinary matter, cosmology appears to require two additional 
forms of matter, the mysterious "dark matter" and "dark energy" contributions to the closure 
of the universe. These of course may have more conventional explanations, but we note that 
in the theory of emergent quantum mechanics developed here, there are three distinct sectors: 
the i e s = i and i e s = —i sectors in the emergent quantum theory, which are not directly 
coupled to one another but which still both interact with the same spacetime metric, and 
the high energy degrees of freedom (given the subscript "12" in Sec. 4E) that anticommute 
with i e ff. Could these correspond, respectively, to the ordinary matter, dark matter, and 
dark energy sectors? Settling such speculations will require understanding precisely how 
gravitation, and the standard model particle forces, fit into our framework. 

(5) The cosmological constant 

Another indication that quantum mechanics may have to be modified to deal with gravi- 
tational phenomena is provided by the problem of the cosmological constant. In conventional 
quantum field theory it is very hard to understand why the observed cosmological constant is 
120 orders magnitude than the natural scale provided by the Planck energy. Either unbroken 
scale invariance or unbroken supersymmetry would forbid the appearance of a cosmological 
constant, but they also forbid the appearance of a realistic particle mass spectrum, and so in 
conventional quantum theory they do not provide a basis for solving the cosmological con- 
stant problem. The difficulty that arises here can be formulated as a mismatch between the 
single constraint needed - a sum rule dictating the vanishing of the cosmological constant - 
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and the infinite number of constraints arising from having conserved operator scale or con- 
formal transformation generators or a conserved operator supercurrent. In trace dynamics, 
we have seen that scale invariance is manifested by the vanishing of the matrix trace of the 
Lorentz trace of the stress-energy tensor TrT^ = T ^ providing a single number condition. 
Similarly, we have seen that supersymmetry implies only the conservation of a trace super- 
current J' 1 (and its conjugate J M ), again providing a single number condition. Neither the 
vanishing of TJ* nor the conservation of J M imply corresponding conditions on the operators 
or J M . Thus in a suitably constructed unified trace dynamics theory of the forces, it is 
possible that either scale invariance [44] or supersymmetry could provide a single number 
constraint forcing the vanishing of the cosmological constant, without simultaneously forcing 
the emergent quantum field theory to be either massless or exactly super symmetric. 
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Appendices 

To keep the discussion of this book self-contained, a number of topics that are briefly 
mentioned in the text are treated in more detail in the appendices that follow. Appendices 
A through F deal with issues related to trace dynamics and our argument that it leads to an 
emergent quantum theory Appendices G, H, and I give a survey of the mathematical and 
phenomenological aspects of the energy-driven stochastic Schrodinger equation. 

The notation of the appendices follows that of the text, except in Appendix I, where some 
changes of notation are introduced in order to make contact with the conventions used in the 
relevant literature. Throughout this book, we indicate sums explicitly, except that the usual 
Einstein summation convention is used for sums over Greek letter four-vector and tensor 
indices. Our Minkowski metric convention is rj^ = diag(l, 1, 1, —1), and we have taken the 
velocity of light to be unity, so that c does not appear in the equations. However, Planck's 
constant h is retained throughout (because our approach implies that it has a dynamical 
origin), except that in the formulas of Appendix I we set h equal to unity. 

Appendix A: Modifications in Real and Quaternionic Hilbert Space 

In a complex Hilbert space the scalars that are used to form superpositions of Hilbert 
space vectors are complex numbers. In real Hilbert space the scalars take only real number 
values, while in quaternionic Hilbert space the scalars can be quaternions of the form r + 
r\i + r 2 j + r 3 k, with r 12,3 real, and with i, j, k the quaternion imaginary units obeying the 
noncommutative algebra i 2 = j 2 = k 2 = — 1 and ij = —ji = k, jk = —kj — i, ki — —ik = j. 
The distinguishing feature of complex Hilbert space is that there is an anti-self-adjoint c- 
number i\ that commutes with all operators on Hilbert space, and the trace can take complex 
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values. By contrast, in real and in quaternionic Hilbert space, there exists no anti-self-adjoint 
c-number, since the only operators that commute with all operators on Hilbert space are of 
the form rl, with r real, and hence are self-adjoint. Also, in real and in quaternionic Hilbert 
space, the trace is real. In real Hilbert space the reality of the trace is self-evident. In 
quaternionic Hilbert space it follows from the fact that the diagonal sum ^2 n (BiB 2 ) nn does 
not obey the cyclic property of Eq. (1.1a) as a result of the noncommutativity of the matrix 
elements (Bi) mn and (-B 2 )„ m in the quaternion algebra; so the trace in the quaternionic 
case must be defined [45] as TrO = Re^ n O nri , which does obey the cyclic properties of 
Eqs. (l.la-c). 

Because there is no anti-self-adjoint c-number in real and quaternionic Hilbert space, in 
these cases one cannot make the choice of Eq. (2.18d) for the matrix A TS that appears in 
the fermion kinetic term. Instead, this matrix must have a nontrivial structure in its indices 
rs; the simplest case, which corresponds to doubling the number of fermion species, arises 
from taking A rs = (iT2) rs , with r 2 the standard Pauli matrix. The main results of Sees. 2-6 
generalize to the real and quaternionic cases, except for those that depend on the fact that 
the complex trace can have a nonzero imaginary part, or on the fact that in complex Hilbert 
space % acts as an anti-self-adjoint c-number. An example of the former is the derivation 
leading from Eq. (5.30a) to Eq. (5.33a), while examples of the latter are the discussions in 
Sees. 4E and 5E that use the diagonalization of i e $ into ±Hr sectors, and the Brownian 
motion discussion of Sec. 5F, which depends on the existence of a complex c-number /C. 
Further details of the results that do generalize, including the Liouville theorem discussion 
of Sec.4A, are found in the Appendices of Ref. [7]. 
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Appendix B: Algebraic Proof of the Jacobi Identity for the 
Generalized Poisson Bracket 

We give here a basis-independent, algebraic proof of the Jacobi identity for the general- 
ized Poisson bracket [2]. For ease of exposition, we shall use a more compact notation than 
was employed in Sec. 1. Derivatives with respect to q r and p r of a total trace functional A 
will be denoted by A r and A r respectively. The operation Tr will be implied by a parenthesis 
( ); this means that we can cyclically permute the factors within a parenthesis, if we include 
a factor e r every time a q r or p r is moved from the front of a parenthesis to the back, with 
e r = 1(— 1) for bosonic (fermionic) degrees of freedom. Thus, in our shorthand notation, 
(q r O) = e r (Oq r ), and the generalized Poisson bracket is given by 

{A, B} = ^2 tr (A r B r - B r A r ) . (B.l) 

r 

It is useful to illustrate with an example how derivatives are computed. Consider the 
case where we have two kinds of matrix variables qi,pi and qi-,Vi- Given the total trace 
functional A = (qiPiq2<liP2<li) , its derivative with respect to q\ is denoted by A x and is given 
by 

Ai = qip^qm + e 1 e 2 p2qiqmq2 + eip^qmqi ■ (B.2) 

The three terms result from the three possible q± factors to differentiate, and the e factors 
come from cyclically permuting the matrix factors to bring the particular q 1 which is to be 
differentiated to the right. 

The first term on the left hand side of the Jacobi identity of Eq. (1.13a), expanded out 
in this notation, is 

{A, {B, C}} = i A > e r (B r C r - C r B r )} , (B.3a) 

r 
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which can be expanded further to 
{A,{B,C}} = ^ e r e s (A s (B r C r ) s -A s (C r B r ) s -(B r C r ) s A s + (C r B r ) s A s ) . (B.3b) 

r,s 

Cyclic permutations of A,B, and C give the other two terms in Eq. (1.13a). Thus, the left 
hand side of Eq. (1.13a) is 

£ e r e s [ (A, (B r C r r - A s (C r B r ) a - (B r C r ) s A s + (C r B r ) s A s ) 

r,s 

+ (B s (C r A r ) s - B s (A r C r ) s - (C r A r ) s B s + (A r C r ) s B s ) (BA) 

+ (C s (A r B r ) s - C s (B r A r ) s - (A r B r ) s C s + (B r A r ) s C s )} . 
Let us first consider how the terms in Eq. (B.4) cancel in the classical, c-number case. 

A similar cancellation mechanism will also apply in the more general matrix operator case. 

For c-numbers, the trace operation is trivial, derivatives of functionals commute, and one 

can apply the Leibnitz product rule to expand the terms. For instance, 

(B r C r ) s = B/CT + B r C rs . (5.5) 

Note that B r s means that the q r derivative is applied before the p s derivative. B s r would 
mean that the same derivatives are applied in the opposite order. This distinction is mean- 
ingless for c-number fields, where derivatives commute, but it is crucial for noncommutative 
operators {q r } and {p r }- 

Equation (B.5) implies that each summand term in Eq. (B.4) will generate two terms. 
These terms cancel in pairs in the c-number case. For example, in the first term in Eq. (B.4), 
consider the derivative with respect to p s applied to B r . This generates the term +A S B/C r . 
This cancels against the term — A r B r s C s obtained by applying the derivative with respect 
to p s on B r in the eleventh term (the dummy indices r and s need to be interchanged for 
the terms to be the same). The other half of the eleventh term will in turn be cancelled by 
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a part of the eighth term, and so on. After twelve such double terms have been computed, 
we come back to the beginning and all terms have been cancelled. 

The order in which these cancellations occur classically in the summand of Eq. (B.4) is 
as follows, 

^(A s (B r C r ) s ) — ((A s B s ) r <T) <— ((A r C r ) s B s ) <— (A r (C s B s ) r ) <— 

(C s (A r B r ) s ) <— ((C s A s ) r B r ) <— ((C r B r ) s A s ) <— (C r (B s A s ) r ) <— (B.6) 

(B s (C r A r ) s ) <— ((B s C s ) r A r ) <— ((B r A r ) s C s ) <— (B r (A s C s ) r ) <— , 
where we have used the fact that r and s are dummy indices and have interchanged them in 

some of the terms, and where the lower right of Eq. (B.6) links back to the upper left. By 

Eq. (B.5), each entry in Eq. (B.6) generates two terms; one of these cancels against a term 

from the entry to the immediate left in the chain, and the other cancels against a term from 

the entry to the immediate right. 

We will now proceed to show that in the general operator case, the cancellations occur 
in a similar way. However, the absence of both commutativity and the Leibnitz product rule 
for operators makes the proof a little less trivial. For the rest of this discussion, we focus, as 
in Eq. (B.6), on the summands which appear, summed over r and s, in the Jacobi identity. 
Also, we will assume that A, B, C are monomials in {q r } and {p r }- The proof for the 
general case of polynomial functionals follows from expanding out the generalized Poisson 
brackets in Eq. (1.13a) in terms of monomials. 

When one computes the derivative of some monomial with respect to q r (say), each 
particular occurrence of q r generates one term in the result. Consider the expression 

(B r cy , (b.7) 

which appears in the first entry of Eq. (B.6). In this expression, there are three derivatives, 
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and there is a sum over the set of choices of which occurrence of q r , p r , and p s is differentiated 
in the appropriate factors. Each one of the set of choices will produce a particular mono- 
mial term in the result. If q r appears N(B, q r ) times in the monomial B, and p r appears 
N(C,p r ) times in C, and so on, then the number of terms produced by Eq. (B.7) is at most 



We will show that in Eq. (B.4), each such monomial term in the result, for fixed r, s 
(i.e., for a fixed choice of q r ,p r , Qs,Ps), wm cancel with its counterpart in the order defined by 
Eq. (B.6). Consider the case where the p s derivative is applied to B in the first entry and the 
q r derivative is applied to B in the second entry of Eq. (B.6). For these to give nonvanishing 
contributions, B must contain at least one instance of both q r and p s . Therefore the most 
general form for B is 



where a and (5 are arbitrary monomials (and could possibly contain q r and p s ). The displayed 
q r and p s are the particular instances of these coordinates in B upon which the derivatives 
will act. 



N(B,q r )N(C,p r )[N(B,p s )+N(C,p s )\. 



B = (aq r (3p s ) , 



(5.8) 



We have 



(A s (B r CT) 



A s ((aq r (3p s ) r C r ) s ) 



e a e r {A s {(5p s aC r ) s ) 



e a e r epe s (A s aC r (5) , 



(B.9) 



and 



((A s B s ) r C r ) 



((A s (aq r (3p s ) s ) r C r ) 
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((A s aq r P) r C r ) 



e p {f3A s aC r ) 



(A s aC r p) . 



(5.10) 



If B is not identically zero [in which case the equality of Eqs. (B.9) and (B.10) is trivial], it 
must have an even number of fermion factors. Therefore, e a e r epe s = 1, and so the right-hand 
sides of Eqs. (B.9) and (B.10) are always the same. Finally, these same cancellations can be 
shown to occur for every summand term in Eq. (B.4) in the order indicated by Eq. (B.6), 
and apply both to the summands with r ^ s and to those with r = s, including the parts 
of the summands with r = s in which there are two derivatives with respect to the same 
variable q r (or p r ). This proves that the Jacobi identity is true for arbitrary bosonic and 
fermionic matrix operator variables {q r } and {p r }- 



We shall demonstrate here that there is a close correspondence [4] between the tangent 
vector field and symplectic structures of trace dynamics and of classical mechanics [46] . Let 
X A be the tangent vector field associated with a trace functional A, defined as a formal 
derivative operator by 



Appendix C: Symplectic Structures in Trace Dynamics 




r 



(CI) 



which by definition acts on any trace functional B as 



X A B = BX A + (X A B) 



(C.2) 
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with (X A B) given by (cf. Eq. (1.11a)) 



(X A B) =Tr 



E 



5 A SB 5A5B\ 

r Sq r 8p r 8p r 5q r J 



m f5A5B 5B5A\ ~ 

= T ^(t-t--t-t-)={^} 



(C.3) 

Sq r 5p r 5q r Sp r ) 

In terms of this operator, the time development of a general trace functional B[{g r }, {p r }} 
with no intrinsic time dependence, under the dynamics governed by A as trace Hamiltonian, 
can be written as (cf. Eq. (1.11b)) 

f = -(A' A B) . (C.4) 

Thus the tangent vector field X A can be viewed as (minus) the directional derivative along 
the time evolution orbit (called the phase flow in [46]) of the phase space point ({q r }, {Pr}), 
which is determined by the Hamiltonian equations of motion 

5 A . 5 A 

Pr = —=— , q r = e r — , (C.5) 
oq r op r 

with A acting as the total trace Hamiltonian and with the dot denoting a time derivative. 
Following the terminology of classical mechanics [46] , we call a tangent vector field of the form 
of Eq. (C.l) a Hamiltonian vector field. It is easily verified that the directional derivative 
Xa obeys the Leibnitz product rule when applied to the generalized Poisson bracket, 

(X A {B,C}) = {(X A B),C} + {B,(X A C)} , (C.6) 

because this equation is equivalent to the Jacobi identity of Eq. (1.13a). 

Let us now study the algebraic structure of Hamiltonian vector fields, by computing the 
action of the commutator of two tangent vector fields X A and X B on a third trace functional 
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c, 



([X A ,X B ]C) =(X A (X B C)) - (X B (X A C)) 



{A,{B,C}}-{B,{A,C}} 



(C.7) 



{A,{B,C}} + {B,{C,A}} 



Using Eq. (C.3) with A replaced by {A, B} and B replaced by C, we also get 



(X {A , B} C) = {{A,B},C}} 



(C.8) 



and subtracting Eq. (C.8) from Eq. (C.7) gives finally 



(([*a,*b]-* { a,b } )C) 



(C.9) 



{A, {B, C}} + {C, {A, B}} + {B, {C, A}} = 



Hence the validity of the Jacobi identity for the generalized Poisson bracket implies that the 
Hamiltonian vector fields Xa obey the commutator algebra 



and thus form a Lie algebra that is isomorphic to the Lie algebra of trace functionals under 
the generalized Poisson bracket. This gives a trace dynamics analog of a standard result [46] 
in classical mechanics. 

We next show that the symplectic geometry of classical mechanics extends to trace 
dynamics, and, as in the classical case, it is preserved by phase space flows produced by 
Hamiltonian time evolutions. Symplectic geometry is defined by an antisymmetric metric 
in the tangent or cotangent spaces of a phase space. (This contrasts with with Riemannian 
geometry, which is defined by a symmetric metric in the tangent or cotangent spaces of a 
manifold.) To avoid differential forms, let us work in the cotangent space, which is spanned 
by covariant vectors the components of which form the gradient of a function on phase space. 



[X A , X B ] — Xr AjB } 



(CIO) 
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The standard symplectic metric, or inner product, between two classical functions on phase 
space is provided by their classical Poisson bracket. The analogs of classical functions in 
trace dynamics are trace functionals, with differentials given by the phase space version of 
Eq. (1.3b), 

We can then use the generalized Poisson bracket to define a generalized symplectic structure 
Q on the operator phase space, by defining the inner product between two cotangent vectors 
S A and 5B by 

fl(5A, 5B) = {A, B} . (C.12) 

To see that this symplectic structure is preserved by the Hamiltonian dynamics given by 
Eq. (C.4), we observe that the time derivative of the inner product along the phase flow is 

jQ(5B, SC) = j f {B, C} = {{B, C}, A} , (C.13a), 

while that of the differential 5B along the same flow is 

^-8B = SB . (C.136) 
at 



Therefore we have 

n{SB, 5C)+Q{5B, SC) = {B, C} + {B, C} 



(C.13c) 



={{B,A},C} + {B,{C,A}} , 
which comparing with Eq. (C.13a) and using the Jacobi identity of Eq. (1.13a) implies that 

^-Q(SB,5C) = n(5B,5C) + n(5B,5C) . (C.14) 

In other words, the symplectic structure is invariant under Hamiltonian phase flow. This 
statement can be viewed as a dual form of the Liouville theorem for trace dynamics. 
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Thus, trace dynamics, with noncommuting operator phase space variables, nonetheless 
has an underlying symplectic geometry which is preserved by the time evolution generated 
by any trace Hamiltonian, or equivalently, by the flow corresponding to any general canonical 
transformation as defined in Eq. (2.13a). This is due to the existence of a graded trace Tr, 
that permits cyclic permutation of the noncommuting operator variables, which implies the 
validity of the Jacobi identity for the generalized Poisson bracket. Hence, in analogy with 
classical mechanics, the basic concepts and theorems of trace dynamics will be invariant 
under the group of transformations that preserve its generalized symplectic structure. 

Appendix D: Gamma Matrix Identities for Supersymmetric 
Trace Dynamics Models 

We give here the gamma matrix identities needed for carrying out the calculations in- 
volving supersymmetric trace dynamics models sketched in Sees. 3A, 3B, and 3C. 

For the calculations of Sees. 3A and 3B, it is convenient to use Majorana representation 
7 matrices constructed explicitly as follows. Let o"i,2,3 and 71,2,3 be two independent sets of 
Pauli spin matrices; then we take 

7° = - 7o = -i<7 2 Ti , 

7° =h° =<?2Tl , 

7 1 =7i = o"3 , 

7 2 =72 = -cr 2 r 2 , (D.la) 

7 3 =73 = -07 , 

7s =?7 1 7 2 7 3 7° = -^2T3 , 
7°75 =ir 2 , 
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so that 7°,75,7°75 are skew symmetric and 7 1 ,7 2 ,7 3 are symmetric, and 

7 V T 7° = -7 M • (D.lb) 

For this choice of 7 matrices, the four matrices 7^ are real. 

To prove supersymmetry of the trace dynamics version of the Wess-Zumino model, one 
uses cyclic invariance of the trace together with the cyclic identity valid for Majorana rep- 
resentation 7 matrices, 

E ^ + (7°75W7°75U = . (D.2) 

cycle a^b— >d— >a 

To prove supersymmetry of the trace dynamics version of the supersymmetric Yang-Mills 
model, one uses cyclic invariance of the trace together with another cyclic identity valid for 
Majorana representation 7 matrices, 

E (7VU(7°7m)c<* = • (D.3) 

cycle a— »6— *d^a 

To verify closure of the supersymmetry algebra under the generalized Poisson bracket, one 
can proceed in either of two ways. The first is to directly rearrange into the expected form, 
verifying along the way the various 7 matrix identities that are needed; for example, in the 
case of the Wess-Zumino model, one needs the cyclic identity of Eq. (D.2) together with 
the additional identity (with £, m, n spatial indices, and ee mn the three index antisymmetric 
tensor with 6123 = 1) 

llblld + Idblla ~ {l^abiflbjcd - (7^75 )db{flh)ca 

(DA) 

= 5ad(l°l£)bc ~ {l Q lt)adhc + Umn{iatnlh)ad{ian)cb ■ 

An alternative method for verifying the closure of the supersymmetry algebra is to first Fierz 
transform using the standard Fierz identity given in Eq. (A. 80) of the book of West [11], 
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so as to isolate expressions of the form a T T(3, and then to show that the coefficients of the 
various terms of this type, with different Dirac matrix structures T, have the form required 
by closure. 

The identities of Eqs. (D.2-4) are representation covariant, in that they do not take the 
same form in representations in which the Dirac gamma matrices are complex rather than 
real. To see this, we note that the matrices in a general representation 7^ are related to the 
Majorana representation matrices 7^ given above by 



with U a unitary matrix which in general is complex, as a result of which the row and column 
indices transform with different matrices. However, the identities of Eqs. (D.2-4) mix row 
and column indices; for example, in Eq. (D.2) there is one term in the cyclic sum in which 
a is a row index, and two terms in which a is a column index. (By way of contrast, the 
more familiar Fierz identities only interchange two row indices, and so do not mix row and 
column indices.) Hence we cannot get a representation invariant form of the identity by two 
applications of Eq. (D.5), since in the second and third terms of the cyclic sum, we will have 
a row index contracted with a U and a column index contracted with a U*, which does not 
correspond with Eq. (D.5). However, we can easily get a representation covariant form of 
Eq. (D.2) by contracting all indices with a U* , and wherever U* contracts with a column 
index using the identity 



with 7 a matrix that appears on pp. 341-342 of the book of Adler [1] (which is introduced 
there because it plays a role in the transformation properties of the Dirac equation in quater- 
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7 £ = rfrfu = u t *yu 



(D.5) 



U* = UU* T U* = U-f* , 7 = U T U 



(D.6) 



nionic quantum mechanics). We can then apply Eq. (D.5) to all the gamma matrices, giving 
for Eq. (D.2), for example, the representation covariant form 

£ KtVWtV)* + (7°757*U(7°757*U = . (D.7) 

cycle a—*b^d^a 

For a change of representation which preserves reality of the 7 matrices, we have U* = 
U, 7 = U T U = U* T U = 1, and Eq. (D.7) is identical to Eq. (D.2), but for general changes 
of representation the identity is form covariant but not form invariant. 

For the calculations in the "M Theory" model of Sec. 3C, one uses a set 7, of nine 16 x 16 
matrices, that are related [14] to the standard 32 x 32 matrices T M as well as to the Dirac 
matrices of spin(8). A number of properties of the real, symmetric matrices 7, play a role in 
the calculation. These matrices satisfy the anticommutator algebra 

{H,l i } = 25 ij , (D.8) 

as well as the cyclic identity 

£ (S mn S pq - 7f n 7H = , (D.9) 

cycle p~ +</-+n^p 

with i again summed over and with the indices m, n, p, q spinorial indices ranging from 1 to 
16. (The identity of Eq. (D.9) also has the same spinor index appearing both as a row and as 
a column index, and so is only form covariant under changes of gamma matrix representation, 
and is obtained by chiral projection with |(1 — ^r 9 ) from Eq. (4. A. 6) of [14].) Defining 

lij = \[lhlj\ , (D. 10a) 

so that 

lilj = Sij + lij , (D. 106) 
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one readily derives from Eq. (D.9) an identity given in [47], 

ITU" + TgiT + (m^p) = 2(7^ - If* 8"*) . (£>.10c) 

By standard gamma matrix manipulations using Eq. (D.8), one also derives the the fact that 
the matrix 

A ijk = liljlk - <%7fc + Sik'jj - Sjk'ji (D.ll) 

is totally antisymmetric in the indices k (it is just the antisymmetrized product ^y^k] 
with normalization factor |), as well as the identity 

2 {lira, lij) = Hilmlilj] + &lfiim - ^mj^ii , (D.12) 

with the first term on the right the antisymmetrized product including normalization factor 
j_ 

24' 

Appendix E: Trace Dynamics Models With Operator Gauge Invariance 

In Sec. 3B, we studied the trace dynamics version of the supersymmetric Yang-Mills 
model, which is an example of a general class of trace dynamics models with a local operator 
gauge invariance, and a corresponding operator constraint. In Sec. 4D, we discussed methods 
for taking this constraint into account in forming the canonical ensemble and the partition 
function. Lest it appear that operator gauge invariance is linked to supersymmetry, we give 
here further examples [1] of trace dynamics models, now non-supersymmetric, which admit 
an operator gauge invariance. 

As our first example, we consider a matrix scalar field 0, which is not restricted to be 
self-adjoint (or anti-self- adjoint), and which is subjected to the general local gauging 

-> U<t>U' ] , UU ] = U ] U = U'U' ] = U' ] U' = 1 , (E.la) 
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with U and U' independent unitary matrices. (Thus, the superscript ' (prime) in this Ap- 
pendix does not have the significance of "noncommutative part" as in the discussion of 
Eqs. (2.16a-c) of Sec. 2.) Let us introduce independent anti-self- adjoint gauge potentials 
B'^ which transform as 

B, - UB^rf - (d,U)U^ , 5; - U'B'^U* - (d„U')U* , (E.lb) 

and the covariant derivative and field strengths 

D^ = d^ + B^-<PB'^ , 

F lu , = d lt B v -d v B li + [B li ,B v ] , (E.lc) 

F l v = d^K ~ d u B'^ + [B^, B' u ] , 
which correspondingly transform as 

- UD^U* , Fpy - UF^rf , F'p V - U'F'^U* . {Eld) 

Then the trace Lagrangian density given by 
C — Ccj, + Cb + Cb 1 , 

£<p = Tr ji [-(£>^)t£)^ - m 2 0V] _ * (^2 j > ^ ^ 

1 „ „,..A „ „ / 1 



is gauge invariant, as may be verified by substituting Eqs. (E.la-d) and using cyclic invariance 
under the trace. The trace Lagrangian L and action S are formed from C by the usual recipe 



L 



= J d 3 xC , S = J dtL . (E.2b) 



When we form the Euler-Lagrange equations by varying S, through SF^ and SF' we en- 
counter new covariant derivatives and D'^ defined by 

D ll O = d ll O + [B lt ,0], D' ll ,0 = d,0+[B'p,0} , 

(E.Sa) 

5Fp U = Dp5B u - DJB, , 5F'p V = D'^ - D'JB'^ , 
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and in integrating by parts we use the following "intertwining identities" that are easily 
derived from Eqs. (E.lc) and (E.3a), 

D' ll (p^) = (D II p)^ + p^D fl r ] , 

(£.36) 

d,Tr (p^t) = Tr [(D^rf + p(D^} , 

^Tr (p^rj) = Tr [{D^-q + p^D^] , 
which apply when p and r\ are both bosonic or both fermionic in type. We then get the 
operator equations of motion 

D^D^ - (m 2 + A# f )0 = , 

= g 2 J u , J V = X - [<t>{D v <t>^ - {D v <t>)<^] , ( E .3c) 
D^F^=g' 2 X, Jl= l -[^D V <P-{D U <P)^} , 

in which the v — components of the gauge field equations are constraints. 

We turn next to the case of fermion fields, starting again with the operator gauging in 
which there is a fermion if) transforming as 

if) -> Uif>U* . (EAa) 

The total trace Lagrangian density analogous to Eqs. (E.2a) is 

£ = + C B + C B > , (EAb) 

with Cb and Cb> as in Eq. (E.2a), and with C$ given by 

=Tr(-# t 7 7' i D M ^ + imif)^°if)) , 
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(EAc) 



This Lagrangian density is again gauge invariant, and varying the trace action S to get the 
corresponding Euler-Lagrange equations, we find the operator equations of motion 

(-fDp + m)il> = , 

D^F^^g 2 ^ , X = # T 7 J7°V T , (EAd) 

D>»F^ = (g>fX, X = i^l°l^ , 
with T indicating Dirac index (but not operator) transposition. Since ip and tp^ are noncom- 
mutative matrix operators, the current J v is not equal to —J' v , as it would be if ip, ^ were 
c-number Grassmann spinors. Again, the v — components of the gauge field equations are 
constraints. 

A further discussion of the bosonic and fermionic models briefly described here, including 
their Hamiltonian form and their discrete symmetries, can be found in [1]. 

Appendix F: Properties of Wightman Functions Needed 
for Reconstruction of Local Quantum Field Theory 

We review here, following [24], the properties of Wightman functions that are needed for 
the reconstruction from them of local quantum field theory. For simplicity, we consider the 
case of a single self-adjoint scalar field <f>(x). Letting |vac) denote the vacuum state, which 
is assumed unique, the Wightman functions are defined by 

W(xi,x 2 , -,x n ) = (vac|0(xi)0(x 2 )...0(x n )|vac) , (F.l) 

for all n ranging from to oo. Starting from the axioms of local quantum field theory, 
a number of properties of these functions can be derived. Conversely, given Wightman 
functions satisfying the following properties, one can reconstruct a local quantum field theory: 
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(i) Smoothness properties 

The functions W({x}) must be tempered distributions. 

(ii) Covariance 

The functions W({x}) must satisfy the requirements of Poincare invariance. Translation 
invariance requires that 

W(x 1 ,x 2 ,...,x n ) = W(x 1 -x 2 ,x 2 -x 3 ,...,x n - 1 -x n ) = W(fi,f2,...,f„-i) = W({£}) . (F.2) 

Lorentz invariance for a scalar field requires that 

wm) = wm}) , (^.3) 

with A ^ a proper orthochronous Lorentz transformation. When fields with spin appear in 
the Wightman functions, Eq. (F.3) must be modified to include the appropriate Wigner 
rotations acting on the spin indices. 

(iii) Spectral Condition 

Let VV(pi,p2, ■■■,Pn) an( i W(qi,q 2 , ...,q n -i) be the Fourier transforms of the Wightman 
functions defined by 

/n 
dx 1 ...dx n exp(-i^2p j ■ x j )W(x 1 ,x 2 , ...,x n ) , 

. 't, <™> 

W(q 1 , q 2 , g n -i) = / d£i...d£ n _i exp(-i q A ■ QW(^, £ 2 , £ n _i) . 
J i=i 

These must be related by 

n 

W(pi,p 2 ,...,Pn) = (2Tr) 4 5(J2p j )W(p 1 ,p 1 + p 2 , + p 2 + ... + p n _i) , (F.5a) 
and we must have 

^(gi,<Z2, ...,<Zn-i) = , (F.56) 
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for any qj not in the forward light cone defined by q° > \q\. 

(iv) Local Commutativity 

The Wightman functions must obey 

W{x!, ...,Xj,x j+1 , ...,x n ) = W(x 1 , ...,x j+1 ,Xj, ...,x n ) , j = 1,2, ...,n- 1 , (F.6) 

whenever and are spacelike separated. 

(v) Hermiticity and Positivity Conditions 

The Wightman functions must obey the Hermiticity condition 

W(x-l,...,x n )=W(x n ,..., Xl )* , (F.7a) 
where * denotes the complex conjugate. They must also obey the positivity condition 
^2 /•••/ dx i--- dx j d yi--- d ykfj(xi,---,x j )*W(x j ,...,x 1 ,y 1 ,...,y k )f k (y 1 ,...,y k )>0 , (F.7b) 

for all finite sequences f , fi(xi), f2(xi,x 2 ), ... of test functions. 

(vi) Cluster Property 

The Wightman functions must cluster, in the sense that 

lim [W(xi, Xj, Xj + i + Sa, x n + Sa) — W(xi, Xj)W(xj + i, x n )] = , (-F-8) 

when the unit four-vector direction a of increasing separation S is spacelike, 

The proof of the reconstruction theorem, assuming Wightman functions obeying the 
conditions enumerated above, is given in [24], and a recent discussion is given in [48]. 
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Appendix G: Proof of Reduction with Born Rule Probabilities 

We give here the proof, following ideas in [37,49,28], that Eqs. (5.51d,e) imply state vector 
reduction to energy eigenstates with the Born rule probabilities. We begin by reviewing the 
derivation of Eq. (5.51e) from Eq. (5.51d). This calculation uses the Ito calculus rules given in 
Eqs. (5.49b) and (5.49d), to which an excellent expository introduction can be found in [50]. 
We start from the stochastic differential equation for the state vector given in Eq. (5.51d), 
together with its adjoint, 

d \V) = - ih- l H c ^)dt - l -[(5 2 R {H eS - (H cS )) 2 + P 2 H 2 s ]\V)dt 



+P R (H eS - (H eS ))\V)dW t R + ifaHrtWdW* , 



(G.l) 



d{9\ ={m\ih- l H cS dt- (V\±[p 2 R (H eS - (H cS )) 2 + p 2 H 2 s ]dt 

+(V\P R (H eS - (H cS ))dW t R - WifaHadW* . 
Substituting these into 

dp=(d\m*\ + m(dm+(d\md(n , (g.2) 

which follows from Eq. (5.49d) as applied to the definition p — |^)(^|, and using the stochas- 
tic calculus rules of Eq. (5.49b), we obtain after some straightforward algebra Eq. (5.51e), 
which we repeat here for convenience, 

dp = th~ l [p,H cS }dt-^\p\ 2 [H cS , [H cS ,p}}dt + p R [p, [p,H cS }]dW R + i(3j[H eS ,p\dWl . (G.3) 

We begin by remarking that for any operator G commuting with H e s, we have 
E[d(G)} =E[TrGdp] = TiGE[dp] 

=TrG(^ _1 [£'[p], ifeff] - \\(3\ 2 [H eS , [H cS ,E[p]]])dt (G.4) 

^Tr&H^i-ih^Elp] - ^\P\ 2 [H cS ,E[p]])dt = , 
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where E[...] denotes the expectation with respect to the stochastic process, with E[dW t R ] = 
E[dWl] = 0. Consider now the energy variance (the squared energy uncertainty), defined 
by 

V = ((ifrff - (H cS )) 2 ) = TrpH 2 a - (TrpH cS ) 2 . (G.5) 

Using the Ito product rule of Eq. (5.49d), together with the result of Eq. (G.3), we have 
dE[V] =E[dV] = -E[Tr(d P H cS )} 2 

(G.Qa) 

= - P%E[Tr(\p, H cS ]) 2 ] 2 dt = -Af3 2 R E[V 2 ]dt . 
Integrating with respect to time, we see that the expectation E[V] satisfies the integral 

equation 

E[V(t)\ = E[V(0)] - Ap\ f dsE[V(s) 2 ] , (G.66) 

Jo 

which using the inequality < E[(V — -E[V]) 2 ] = E[V 2 ] — E[V] 2 gives the inequality 

E[V{t)\ < E[V(0)} - API f dsE[V(s)] 2 . (G.6c) 

Jo 

Since the variance V is necessarily non-negative, Eq. (G.6c) implies that E[V(oo)] = 0, and 
again using non-negativity of V this implies that V(s) vanishes as s — > oo, apart from a set 
of outcomes occurring with probability zero. Thus the stochastic Schrodinger equation of 
Eq. (G.l) drives as t — > oo, to a definite energy eigenstate when the energy eigenvalues 
are nondegenerate, which for the time being we assume. (We shall consider the degenerate 
case shortly.) 

To see that Born rule probabilities emerge, we apply Eq. (G.4) to the projectors Il e = 
| e) (e | on a complete set of energy eigenstates |e). By definition, these projectors all commute 
with H c fi, and so by Eq. (G.4) the expectations -E[(Il e )] are time independent; additionally, 
by completeness of the states |e), we have ^ e (n e ) = 1. But these are just the conditions 
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for Pearle's [35] gambler's ruin or martingale argument to apply. At time zero, when the 
stochastic evolution has just started, £'[(n e )] = (Il e ) = p e is the absolute value squared 
of the quantum mechanical amplitude to find the initial state in energy eigenstate |e). At 
t = oo, the system always evolves to an energy eigenstate, with the eigenstate |/) occurring 
with some probability Pf. The expectation £'[(n e )], evaluated at infinite time, is then 

E[(U e )] = lxP e + J2^xPf = Pe ; (G.7) 

/A 

hence p e = P e for each e and the state collapses into energy eigenstates at t = oo with 
probabilities given by the usual quantum mechanical Born rule applied to the initial wave 
function. 

Let us now consider the case in which the Hamiltonian H e g is degenerate. In this case, 
let us choose a basis of energy eigenstates so that, within each degenerate manifold, one basis 
element coincides (after normalization) with the projection of the initial state vector into 
that manifold, and the others are orthogonal to it. (If the projection of the initial state vector 
into the manifold vanishes, any orthonormal basis for that manifold suffices.) We can then 
apply the argument just given for the nondegenerate case, using this specially chosen energy 
eigenstate basis. We learn that the state vector reduces to one of the members of this basis, 
with a probability equal to the modulus squared of the projection of the initial state vector 
on this basis. Thus, the state vector reduces into one or another of the degenerate energy 
manifolds, with the result of reduction being the normalized projection of the initial state 
vector into that manifold, and with the probability of obtaining this outcome equal to the 
squared modulus of the projection of the initial state into the manifold [51]. This is precisely 
the result expected from the Liiders projection postulate, which generalizes the Born rule 
to the degenerate case. Heuristically, the reason the Liiders rule arises from Eq. (G.l) is 
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that this equation has the form d\ty) = 0\*f>), with O diagonal on an energy basis. Thus 
any energy eigenstate component that has coefficient zero in the eigenstate expansion of the 
initial state vector cannot obtain a nonzero coefficient through the subsequent stochastic 
evolution. 

Finally, referring to Eqs. (G.6a-c), we see that state vector reduction occurs only when 
(5r 7^ 0, since the fa term in Eq. (G.l) does not contribute to the evolution of the variance. 
When f3 R — and fa ^ 0, the initial state vector still evolves stochastically, but the energy 
variance remains constant in time. The necessity for having f3 R ^ to achieve reduction 
motivates the detailed discussion in Sec. 5F of how to achieve a nonzero /Ci, which is related 
to Pr by Eq. (5.49a). 

Appendix H: "No Go" Theorem for Heisenberg Picture Reduction 

In Sec. 5F we encountered difficulties in giving an operator formulation of state vector 
reduction, which were surmounted by projecting Eq. (5.47e) on the vacuum state. Here we 
shall work backwards from the state vector reduction equations given in Eq. (G.l), and will 
prove the following: 

"No go" theorem. When (3 R ^ 0, the linearized form of Eqs. (G.l), 

=(3 R H cS \V)dW t R + ifaHrfWdW* + 0(dt) , 

(H.l) 

d(*\ =(V\p R H cS dW t R - WfaH cS dW t T + O(dt) , 
cannot be interpreted as the vacuum projection of a general operator equation that satisfies 
the Leibnitz product (or "chain") rule to order 0(dt), and also has a stochastic differential 
d that commutes with the operator adjoint f. 
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To prove this, we write = \pt|vac), and look for an evolution equation for a general 
operator O that, when applied to O = \Ed, gives Eq. (H.l) when acting on the vacuum state. 
Since we need a structure that is linear in if e g, there are only two irreducible possibilities 
for giving the f3 R term an operator interpretation. In the first we write 

d 1 = p R [H eS ,0]dW t R + i(3 I [H eS ,0]dW t I + 0(dt) , (H.2a) 

and in the second we write 

d 2 = p R {H cS ,0}dW t R + tP I [H eS ,0}dW t I + 0(dt) , (H.2a) 

both of which give the first equation in Eq. (H.l) when acting from the left on |vac). However, 
although Eq. (H.2a) obeys the chain rule for differentiation, 

d 1 (0 1 2 ) = (d 1 1 )0 2 + 1 (d 1 2 ) , (H.3a) 

it defines a differential that does not commute with the adjoint t, since according to Eq. (H.2a) 
we have 

(rf 1 G) t = -p R [H cS , 0}dW t R + i(3i[H e{{ , <D\dWl + O(dt) 

(if .36) 

M(O f ) = MH e s, 0^}dW t R + i(3i[H e{{ , 0^\dW l t + O(dt) . 
Similarly, although Eq. (H.2b) defines a differential that commutes with the adjoint t, 

(d 2 Oy = d 2 (0^) , (HAa) 

it does not obey the chain rule for differentiation, since the anticommutator structure mul- 
tiplying j3 R dW R behaves as 

{H eS ,0 1 2 }^0 1 {H eS ,0 2 } + 1 {H eS ,0 2 } . (if .46) 
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Because the most general differential d with the required action on the vacuum state is a 
linear combination of d\ and d 2 , 

d = c\d\ + c 2 d 2 , ci + c 2 = 1 , (H.5) 

there is no d that both commutes with the adjoint and obeys the chain rule, completing the 
proof. 

Appendix I: Phenomenology of Energy Driven Stochastic Reduction 

We discuss here phenomenological aspects of the energy driven stochastic reduction 
equation given in Eqs. (5.51d,e). We shall address the following issues: clustering, bounds 
on the stochastic term implied by the maintenance of coherence where that is observed, 
the role of environmental interactions in reduction, and estimates of the reduction rate in 
measurement situations (assuming a Planckian magnitude for the coefficient (3r). 

We begin with some changes in notation, that are helpful in making contact with the 
relevant literature. Since we have seen in Appendix G that the fa term in Eqs. (5.51d,e) 
does not lead to state vector reduction, we shall set fa = 0, and shall write (3r = \o, with 
a the notation used for the stochastic parameter in [49], [28], [32], and [33]. We shall also 
omit: the caret on the density matrix p, which we shall write simply as p, the subscript "eff" 
on H cS , which we shall write simply as H, and the superscript R on dW t R , which we shall 
write simply as dW t . Finally, we shall set Planck's constant h equal to unity. Note that H, 
a and p will now have different meanings from those assigned to these symbols in the trace 
dynamics discussion of the text! 

With these changes of notation, Eq. (5.51d) of the text and Eq. (G.l) of Appendix G 
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take the form 

d\V) = -iH\V)dt- -a 2 (H- (H)) 2 \^)dt + -a(H- (H))\V)dW t . (/.I) 
8 2 

Similarly, the density matrix evolution of Eq. (5.51e) of the text and Eq. (G.3) of Appendix 
G becomes 

dp = i[p,H]dt- l -a 2 [H,[H,p}}dt+ l -aN(p,H)dW t , (1.2) 

where the coefficient N(p, H) of the Ito noise term dW t is 

N(p, H) = {p, H} - 2pTrpH , (7.3a) 

which by use of the pure state condition p 2 = p is equivalent to 

N(p,H) = [p,[p,H]] . (1. 3b) 

Both of these forms have the property that p 2 = p implies that {p, dp} + (dp) 2 = dp, which 
can be rewritten as (p + dp) 2 = p + dp, and so they preserve the pure state condition. 

We begin our discussion with the issue of clustering. The Hamiltonian H appearing 
in Eqs. (I.l)-(I.3a,b) is the total world Hamiltonian. In order for these equations to give 
a sensible phenomenology of reduction, they must separate under appropriate conditions 
into independent equations for isolated, noninteracting subsystems. Following [28] and [33], 
we study this question by considering the case of two independent subsystems, so that H 
is the sum of two Hamiltonians Hi, H 2 which depend on disjoint sets of variables, and 
investigate the conditions under which Eqs. (1.2) and (I.3a,b) admit factorized solutions 
P = P1P2, with p 12 obeying equations of similar form driven by the respective Hamiltonians 
ifi i2 . Substituting H = Hi + H 2 and p = pip 2 into Eqs. (1. 3a), (1. 3b), and using the facts 
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that all variables in set 1 commute with all variables in set 2, and that Tr = TriTr 2 , we find 
from Eq. (1. 3a) that 

N(p 1 p 2 , E x + 77 2 ) = f>2[{pu Hi} - 2piTr 2 p 2 Tripii7i] + pi[{p 2 , 77 2 } - 2p 2 Tr 1 p 1 Tr 2 p 2 H 2 ] , 

(7.4a) 

while from Eq. (1. 3b) we find that 

N(p lP2 , Hi + H 2 ) = p 2 2 [ Pl , [ Pl , Hi]] + p\[p 2 , [p 2 , H 2 \] . (7.46) 

Clustering requires that 

N(p lP2 , 77i + 77 2 ) = p 2 A^i(pi, 770 + Pi^ 2 (p 2 , 77 2 ) , (7.5) 

with Ni t 2 the restrictions of to the 1,2 subspaces. We see that Eq. (1. 4a) obeys the 
clustering property by virtue of the trace conditions TVipi = 1, Tr 2 p 2 = 1, while Eq. (1. 4b) 
satisfies the clustering property by virtue of the pure state conditions p\ — p±, p\ — p 2 . 

Let us now examine the clustering properties of the remaining terms in Eq. (1.2). For 
the left hand side, we find by use of the It 6 extension of the chain rule that 

d{pip 2 ) = p 2 dpi + p\dp 2 + dpidp 2 . (7.6a) 

Thus, in order to have dpi an d dp 2 obeying equations of the same form as dp but restricted 
to the 1, 2 subspaces, the left hand side should take the form 

d{pip 2 ) = p 2 d Pl + Pl dp 2 + -<J 2 7Vi(pi, 77 1 )A^ 2 (p 2 , 77 2 )dt . (7.66) 
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For the dt terms on the right hand side of Eq. (1.2), we have 

i[piP2,#i + H 2 ]dt-\a 2 [H l + H 2 , + H 2 ,p lP2 }}dt 

o 

=p 2 {t[ Pl , H x ]dt - \<J 2 [Hi, [Hi, Pl ]]dt} 

I (/-6c) 

+ Pl {i[p 2) H 2 ]dt - -a 2 [H 2 , [H 2 , p 2 }]dt} 
o 

-^a 2 [H 1 ,p 1 ][H 2 ,p 2 ]dt . 
Assuming the conditions for the clustering property of Eq. (1.5) to hold for the Ito noise 
term, comparing Eqs. (I.6a-c) we see that the complete density matrix evolution equation 
will cluster if and only if 

N 1 (p 1 ,H 1 )N 2 (p 2 ,H 2 ) = -[H 1 ,p 1 }[H 2 ,p 2 ] . (1.7) 

This condition does not hold as in identity for either of the two possible forms for N(p, H) 
given in Eqs. (1. 3a), (1. 3b), and so the a 2 dt or drift term in the stochastic evolution equation 
does couple disjoint systems. 

However, there are two important special cases in which disjoint systems decouple asymp- 
totically. The first of these cases corresponds [28] to taking N(p, H) as in Eq. (1. 3b), so that 
Eq. (1.7) becomes 

[ Pl , [pi, tfife, [P2,H 2 }\ = -[H 1 , Pl ][H 2 ,p 2 ] . (7.8a) 

This equation is satisfied, by virtue of both the left and right hand sides vanishing, whenever 
either [pi, Hi] = or [p 2 , H 2 ] = 0, conditions that are respectively obeyed when system 1 or 
system 2 is at the endpoint of the state vector reduction process. In particular, if system 1 
represents a measurement process, and system 2 represents a pure state environment at the 
endpoint of its reduction process, then the stochastic dynamics of system 1 is completely 
independent of the dynamics of its environment. 
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A more general case [33] in which disjoint systems decouple asymptotically corresponds 
to taking N(p,H) as in Eq. (1. 3a), but not assuming the pure state condition so that this 
cannot be transformed to Eq. (1. 3b). Equation (1.7) now becomes 

[{pi,ifi} - 2p 1 Tr lPl H 1 ][{p 2 ,H 2 } - 2p 2 Tr 2 p 2 H 2 ] = -[Hi, Pl ][H 2 , p 2 \ . (1. 8b) 

This equation is satisfied, again by virtue of both the left and right hand sides vanishing, 
whenever either Pl is a linear combination of projectors on a degenerate submanifold of Hi, 
or p 2 is a linear combination of projectors on a degenerate submanifold of H 2 . For example, 
in the latter case we would have p 2 H 2 = H 2 p 2 = E 2 p 2 for some degenerate submanifold 
energy E 2 , together with Tx 2 p 2 = 1, which imply the simultaneous vanishing of {p 2 ,H 2 } — 
2p 2 Tr 2 p 2 H 2 and of [H 2 , p 2 \. Thus, if one were to adopt Eqs. (1.2) and (1. 3a) as a generalization 
of the density matrix evolution equation to the case of non-pure state density matrices, a 
pure state measurement process decouples from a mixed state environment whenever the 
density matrix for this environment is a linear combination of projectors on a degenerate 
submanifold of its Hamiltonian. An application of these ideas to the case of thermal mixed 
state environments is given in [33]. 

We note that the conclusions we have reached about clustering do not extend [28] to 
more general stochastic evolutions in which the stochastic process is driven by an operator A 
differing from the Hamiltonian H, with A taken to be additive over subsystems. The reason 
is that there is now a competition between the stochastic terms, which in Eqs. (1.2) and 
(1. 3b) are constructed from double commutators with an innermost commutator [A, p], and 
the Schrodinger evolution term, which involves the commutator [H, p] ; the stochastic terms 
tend to drive the system to A eigenstates, while the Schrodinger term coherently mixes A 
eigenstates, leading to evolution away from A eigenstates. Thus, a subsystem cannot remain 

160 



indefinitely in an A eigenstate, and as a result does not persist indefinitely as an unentangled 
independent subsystem in a larger system. 

Now that we are assured that Eqs.(I.l)-(I.3a,b) can be applied to the evolution of an 
isolated system decoupled from its environment, with the Hamiltonian H referring only to the 
system, we can embark on a discussion of phenomenological implications of these equations 
for measurements. We first need a quantitative estimate of the reduction time given by 
Hughston [49]. Rewriting Eq. (G.6a) in terms of the parameter a, and approximating i?[V 2 ] 
by -E[V] 2 , we get a differential equation for E[V], 

d -m = -a*E[vr , (/.9a) 

which can be integrated to give 

Thus, given an initial energy variance £'[l / (0)] = (AE) 2 and the parameter ex, state vector 
reduction will be completed for times significantly larger that £r, with 

From this equation (or directly from the stochastic Schrodinger equation) we see that a 
has units (mass)~^. So writing a = M~^ : with M the characteristic mass scale for the 
fluctuations that give rise to the stochasticity in the Schrodinger equation, Eq. (1. 10a) takes 
the form 

M 

If one assumes that M is of order the Planck mass M P ~ 10 19 GeV, then one gets the 
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estimate [49] 




2.8MeV 
AE 



2 



sec 



(/.10c) 



Thus, for AE equal to a proton mass, tn ~ 10 



sec, while for AE equal to the mass of a 



nitrogen molecule, one has tn ~ 10 _8 sec. 

In order for stochastic energy-driven state vector reduction to give a viable phenomenol- 
ogy, it must satisfy the twin constraints of predicting the maintenance of coherence when 
this is observed, while predicting a rapid enough state vector reduction when a probabilistic 
choice between alternative outcomes is observed. A detailed analysis of these issues is given 
in [33]; we give here only a brief discussion. 

We first discuss the constraints imposed by the maintenance of coherence. According 
to Eqs. (I.lOa-c), the sole criterion governing how rapidly the state vector reduces is the 
energy variance; whether the system is microscopic or macroscopic plays no role. Coherent 
superpositions of macroscopic states, involving large numbers of particles, will persist in 
time if the energy spread between the superimposed states is small enough. For example, 
consider the recent superconducting quantum interference device (SQUID) experiments [52] 
that observe the existence of coherent superpositions of macroscopic states consisting of 
oppositely circulating supercurrents. The variance AE in the Friedman et. al. experiment 
[52] is roughly 8.6 x 10~ 6 eV, and the circulating currents each correspond to the collective 
motion of ~ 10 9 Cooper pairs. According to Eq. (1. 10c), despite the macroscopic structure 
of the state vector, the state vector reduction time tR for this experiment should be about 
10 23 s ~ 3 x 10 15 yr, and so maintenance of coherence is expected over the measurement time 
of order a millisecond. Similarly, in atomic quantum intermittency experiments [53], which 
involve transitions between a metastable atomic energy level (with a lifetime of around a 
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second) and the ground state, with typical energy separations of a few eV, we expect a state 
vector reduction time for Planckian M of order 10 12 s ~ 3 x 10 4 yr. Hence in this case also, 
the maintenance of coherence is expected. 

We can turn this calculation around, and estimate a lower bound on the mass M ap- 
pearing in Eq. (1.10b) in terms of the time tc over which a superposition of energy states 
differing by AE is observed to remain coherent, 

M > t c (AE) 2 . (7.11a) 

The most straightforward cases to consider are those involving oscillations of neutrinos, Ja- 
mesons, or B-mesons, since these are can be treated as two-state systems with negligible 
interaction with the electromagnetic field, and so Eq. (1. 11a) can be directly applied. For a 
two state system with mass splitting Am, and mean energy E for the components, one has 
AE = Am 2 /(2E), and so we get from Eq. (1. 11a) the estimate 

■ urn 

For neutrinos [54], taking the coherence time t c to be the oscillation time 2n/(AE) = 
AnE I '(Am 2 ), Eq. (I. lib) becomes 

M>2ttAE = — — - , (7.11c) 
E 

which for the parameters appropriate to both the atmospheric (Am 2 ~ 3 x 10 _3 eV 2 , E ~ 
lGeV) and solar (Am 2 ~5x 10~ 5 eV 2 , E ~ 8MeV) neutrino oscillation observations, gives 
to within a factor of two the estimate M > 10~ 20 GeV. For K- and 7?-mesons at rest in the 
lab frame, taking the coherence time tc to be the lifetime ts of the shorter-lived component 
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(which is similar in magnitude to the oscillation time), Eq. (1. 11a) becomes 

M > r s (Am) 2 , (J.lld) 

which for the parameters appropriate to the if-meson system (Am ~ 4 x 10~ 6 eV, ts ~ 
.9 x 10~ 10 s) and to the 5-meson system (Am ~ 3 x 10~ 4 eV, r s ~ 1.6 x l(T 12 s) gives 
respective bounds of M > 2 x 10" 15 GeV and M > 2 x 1(T 13 GeV. The K- and 5-meson 
systems give better bounds than are obtained from neutrinos because for the mesons m/E 
is of order unity, whereas for neutrinos m/E is very small. However, even the meson system 
bounds are far removed from the Planck scale of 10 19 GeV ~ 10 13 eV 2 s. 

Better limits may be obtainable in atomic and nuclear systems. Returning to the SQUID 
experiment discussed earlier, using the value AE ~ 8.6 x 10~ 6 eV, and making the assumption 
that a lower limit for the coherence time tc is given by the millisecond duration of the 
microwave pulse used as a probe, one gets from Eq. (1. 11c) the bound M > 7 x 10~ 14 eV 2 s 
~ 1CT 7 GeV. The existence of nuclear isomer states [55] lying 100-200 keV above the ground 
state and with very long lifetimes offers a possibility of greatly improved bounds, but this 
will require further theoretical work. In the absence of coupling to the electromagnetic field, 
these isomers are energy eigenstates, and so are stable under the stochastic Schrodinger 
evolution. When the electromagnetic coupling is added as a perturbation, the isomers are 
no longer eigenstates of the total Hamiltonian, but to understand what happens the standard 
theories of decay rates, line width, laser action, etc. will have to be generalized to take take 
the stochastic terms in Eq. (1.1) into account. 

We turn now to the second requirement that must be satisfied by a phenomenology 
of state vector reduction, which is that it should lead to rapid reduction in experimental 
situations where a probabilistic outcome is observed. According to the von Neumann model 
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for measurement [56], a measurement sets up a correlation between states \fe) of a quantum 
system being measured, and macroscopically distinguishable states \A4e) of the measuring 
apparatus M., in such a way that an initial state 



An objective state vector reduction model must then account for the selection of one of the 
alternatives \fe)\M.e) from this superposition, with a probability given by |q| 2 . If the energy 
spread among the states \fe) has a typical atomic magnitude of a few eV, then as we have 
seen above, for a Planckian magnitude of M, reduction times in the energy driven model 
are of order 10 4 years, and cannot by themselves quantitatively account for state vector 
reduction. The only way for reduction to occur within typical measurement times is for the 
energy spreads among the alternative apparatus states in the superposition to be much larger 
than a few eV. Since in the ideal measurement model there is no energy transfer from the 
microscopic system to the apparatus, such an energy spread in the measurement apparatus 
states can only be present if induced by environmental interactions, which are ignored in 
the von Neumann analysis. For environmental interactions to be effective in producing state 
vector reduction, they must lead to energy fluctuations AE of the apparatus in the course 
of a measurement, that are large enough for Eq. (1. 10c) to predict a reduction time tn that 
is less than the time it takes to make the measurement. 

A detailed analysis of this issue is given in [33] (see also [28]), following on an initial 
suggestion in [49]. We summarize only a few of the results here. Although different measuring 




(/.12a) 



evolves unitarily to 




(7.126) 
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devices have different response times, let us assume that the relevant measurement time is 
of order 10~ 8 seconds, which requires for reduction a AE ranging up to ~ 30GeV, roughly 
the mass of a nitrogen molecule. The analysis of [33] considered three possible sources 
of energy fluctuations: thermal energy fluctuations, fluctuations in apparatus mass from 
particle accretion processes, and fluctuations in apparatus mass from amplified fluctuations 
in the currents that actuate the indicator devices. Thermal energy fluctuations were found 
to be unable to produce the needed energy fluctuation within the measurement time. On 
the other hand, both energy fluctuations from mass accretion, and from amplified current 
fluctuations, are relevant. 

As illustrations of accretion-induced fluctuations, assuming room temperature and at- 
mospheric pressure (760 Torr), the time for one molecule to be accreted onto an area of 1cm 2 
is 3 x 10~ 24 sec, while at an ultrahigh vacuum of 10~ 13 Torr it is 3 x 10~ 8 sec. Thus, for 
an apparatus in the atmosphere at standard temperature and pressure, where the bulk of 
the accreting atoms are nitrogen molecules, the minimum apparatus area required for one 
molecule to accrete in a reduction time of lCT 8 sec (corresponding to a AE equal to the mass 
of a nitrogen molecule) is 3 x lCT 16 cm 2 , with the corresponding minimum area needed at a 
pressure of 1CT 13 Torr equal to 3cm 2 . Further estimates of this type are given in [33]. For 
example, even in the sparsely populated environment of intergalactic space, one concludes 
that in a typical high precision molecular beam experiment, the reduction time induced by 
particle accretion on a capsule large enough to enclose the apparatus would be smaller, by 
at least an order of magnitude, than the measurement time. 

Estimates can also be made [33] of energy fluctuations arising from the amplified fluctu- 
ations in the currents which actuate experimental indicating or recording devices. Of course, 
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if power sources are included, there are no overall current fluctuations, but power supplies 
are typically large in area and so when included in the system the accretion analysis just 
given indicates rapid reduction times. In a typical electrically amplified measurement, a 
final total charge transfer Ne (with e the charge of an electron) actuates an indicator or 
recording device. Assuming that the fluctuation in the current is the amplified fluctuation in 
the initially detected signal, for amplification gain G we have AN ~Gx (N/G)* = (NG)*. 
Let us take iV to correspond to a charge transfer of 1 milliampere (a voltage change of 10 
volts at 10 kf2 impedance) over a 10~ 8 second pulse, so that iV~6x 10 7 , and assume a gain 
G ~ 10 4 , giving AiV ~8 x 10 5 . Multiplying by the electron mass of .5 x 10~ 3 GeV, we find 
that the corresponding energy fluctuation is AE ~4x 10 2 GeV, which leads to state vector 
reduction in 5 x 10~ n sec. Thus, electric current fluctuations play a significant role in state 
vector reduction when the "apparatus" is defined to exclude power sources. 

Our overall conclusion is that conditions under which laboratory experiments are per- 
formed, as well as conditions under which space capsule experiments might be performed 
in the foreseeable future, are consistent with state vector reduction times as estimated by 
Eq. (1. 10c) that are well within experimental measurement times. As long as experimental 
outcomes are macroscopically distinguishable (which effectively defines an apparatus), the 
energy spread between different outcomes is sufficient to cause the state vector to reduce. 

We note finally that in the analysis of future experiments to improve the phenomeno- 
logical bounds on M, one will either have to solve the stochastic Schrodinger equation an- 
alytically, or simulate it numerically [57], for typical experimental configurations. Powerful 
new techniques for performing such simulations, along with relevant analytical methods, are 
given in [58]. 
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